Working Data Deduplication for Windows 11

For a long time, it has been difficult to find a data deduplication software package available for Windows 11 on the Internet. Now, I am pleased to present a Windows Data Deduplication installation package that works on Windows 11, please note that this is a “third party” add-on package outside of Microsoft, made by me. The deduplication package is extracted from Windows Server 2022 build 22526.1000 and tweaked for installation on Windows 11, It can be successfully installed on Windows 11 22H2 & Windows 11 Insider Preview versions. Only Enlgish & Chinese language systems are supported by default, if you use any other language, you need add your language package extract from Windows Server installation media and replace the .mum files by the tweaked Enlgish version included in this download, and then replace all the string ‘en-US’ by your langugae ID string.

Below I paste the installation script and download link, a more detailed explanation will be added when I have time:


@echo off
@echo Hard Disk Data Deduplication for Windows 10/11
@echo https://blog.kevingu.net/working-deduplication-for-windows-11
:: BatchGotAdmin
:-------------------------------------
REM  --> Check for permissions
net session >nul 2>&1

REM --> If error flag set, we do not have admin.
if '%errorlevel%' NEQ '0' (
    echo Requesting administrative privileges...
    goto UACPrompt
) else ( goto GotAdmin )

:UACPrompt
    echo Set UAC = CreateObject^("Shell.Application"^) > "%temp%\GetAdmin.vbs"
    set params = %*:"=""
    echo UAC.ShellExecute "cmd.exe", "/c %~s0 %params%", "", "runas", 1 >> "%temp%\GetAdmin.vbs"

    "%temp%\GetAdmin.vbs"
    exit /B

:GotAdmin
    if exist "%temp%\GetAdmin.vbs" ( del "%temp%\GetAdmin.vbs" )
    pushd "%CD%"
    CD /D "%~dp0"
:--------------------------------------

REM This installer script runs in offline mode, you cannot use it to integrate dedup drivers into a running Windows system.
REM You can use it in a Windows PE to process the system you want to integrate, the recommended way is to enter the recovery console 
REM of the system you want to process, which is also a PE environment.

REM Put the whole directory which contains this installer script into an accessible disk partition or removable disk, 
REM then start a PE environment to integrate the dedup drivers into your Windows system.

REM Here's a handy way to get to the Windows Recovery Console, if you haven't deleted the Windows Recovery partition that exists by default.
REM Go to Windows 'Settings' and navigate to 'Recovery' under the System section, then click on the 'Restart now' button next to 'Advanced 
REM startup', then your PC will restart into recovery mode, then in the Windows 'Choose an option' interface, select 'Troubleshoot', then 
REM select 'Advanced Options', and finally click the 'Command Prompt' button to enter the Windows Recovery Console.

REM In the Windows Recovery Console, cd to the directory which contains this installer script, e.g. If you have copied the directory to the 
REM partition D, type 'cd /d D:\Dedup-22526', then type 'Install' to run the script, after the install script starts, if the Windows system 
REM which you want to integrate dedup is located at partition C, type C: and Enter to start the processing.

REM If all goes well, after the script finishes running, close the console window and click 'Continue' to boot into Windows.

:Prompt
echo.
echo Enter offline image drive / Windows installatoion drive, e.g. C:
echo.
set /p target=
if not defined target exit /b
set "target=%target:"=%"
if "%target:~-1%"=="\" set "target=%target:~0,-1%"
if not exist "%target%\Windows\explorer.exe" (
echo.
echo ERROR: Not valid Windows image path.
echo Under Windows Recovery mode the drive letters maybe changed, use ‘dir’ plus all possible drive letters to determine the temporary drive letter 
echo of the Windows partition in the Recovery mode, e.g.: dir C:, if not found ‘Windows’, then dir D:… until you found whre your Windows is located.
echo.
pause
goto :Prompt
)

cd /d "%~dp0"
dism /image=%target% /Add-Package /PackagePath=FileServer\update.mum /scratchdir=%~d0\
dism /image=%target% /Add-Package /PackagePath=FileServer-en-US\update.mum /scratchdir=%~d0\
dism /image=%target% /Add-Package /PackagePath=FileServer-zh-CN\update.mum /scratchdir=%~d0\
dism /image=%target% /Add-Package /PackagePath=Dedup\update.mum /scratchdir=%~d0\
dism /image=%target% /Add-Package /PackagePath=Dedup-en-US\update.mum /scratchdir=%~d0\
dism /image=%target% /Add-Package /PackagePath=Dedup-zh-CN\update.mum /scratchdir=%~d0\

set "svc=%target%\Windows\servicing\Packages"

takeown /A /F %svc%\*Dedup*.mum
takeown /A /F %svc%\*FileServer*.mum
takeown /A /F %svc%\*VdsInterop*.mum
icacls %svc%\Microsoft-Windows-Dedup-*.mum /grant *S-1-5-32-544:F
icacls %svc%\Microsoft-Windows-FileServer-*.mum /grant *S-1-5-32-544:F
icacls %svc%\Microsoft-Windows-VdsInterop-*.mum /grant *S-1-5-32-544:F

for %%f in (Originals\*.mum) do (
 copy /y %%f %svc%
 icacls %svc%\%%~nxf /reset
)

REM We need a production version of the dedupe driver file dedup.sys, 
REM here we replace this file with a version from Server 2022 21H2 build 20348.1787.

copy /y dedup.sys C:\Windows\System32\drivers
copy /y dedup.sys C:\Windows\WinSxS\amd64_microsoft-windows-dedup-filter_31bf3856ad364e35_10.0.22526.1000_none_e8e97201539f4322

REM If you disable the driver integrity checks, you can use the original 22526.1000 version of the dedup.sys, comment out the above two lines 
REM of copy commands and uncomment the below two lines to use the included preview version, a system reboot is needed to disable driver checks.

REM bcdedit -set loadoptions DISABLE_INTEGRITY_CHECKS
REM bcdedit -set TESTSIGNING ON

REM You can also use any higher preview version of the dedup.sys, just replace the dedup.sys file in the same directory as this install script
REM with any higher version, leave the above two lines of copy commands unchanged and comment out the disable driver integrity check lines.

echo Done.

Working Deduplication files for Microsoft Windows 11 download:
https://blog.kevingu.net/downloads/Dedup-22526.7z

Please do not sell the above file package or include it in any commercial collection.

Leave a Reply

Your email address will not be published. Required fields are marked *