Build 14393.0

Hello guys, I was very busy these last few months and I got no time to work on this blog... Anyway I made the new Dedup Package for build 14393.0 that I tested on my W10 14393.187 and it is fully functionnal. You can find this package directly from here (md5: 48cdbfddcc4a2266950ad93a6cfe2b9f).As always, to install deduplication feature on your Windows 10 computer, you will just need to launch install.cmd file as administrator. Enjoy.

Build 14300.1000

You will find the deduplication package for build 14300.1000 here (md5 : 6a7ba5b2d6353cc42ff2c001894f64b4). As usual now, to install deduplication feature on your Windows 10 computer, you will just need to launch install.cmd file as administrator. For information, this package is only working for x64 platform (don't forget to open x64 version of powershell to access dedup cmdlets).

Note that I can only build this package if I have the linked Windows Server 2016 build, so if you need a special package for a build of Windows 10 contact me with the link or the .iso of the appropriate Windows Server 2016 build.

Build 14291.1001

You will find the deduplication package for build 14291.1001 here (md5 : b150cd2fe60e314e24cedeafeb6f1f42). To install deduplication feature on your Windows 10 computer, you will just need to launch install.cmd file as administrator.

Build 10586

You will find the new package based on Windows Server 2016 TP4 build 10586 here (md5 : 21251c030d3c1a5572bd0f12473c623c). To install deduplication feature on your Windows 10 computer, you will just have to launch install.cmd file as administrator and voila !

You don't need anymore to be part of Microsoft Insider Program for this build. So just skip text above until PS module usage here. If you want more information about available cmdlets and usage, you can read my article here.

Build 10514

Until now if you wanted to make use of deduplication on your Windows client operating system, especially on Windows 8.1 you had to reuse deduplication module of Windows Server 2012. But as you probably know, Windows 10 still does not provide this functionality by native, and the old module used for Windows 8.1 is not compatible... So perhaps you still have not migrated to Windows 10 because of this ?! Well I'm glad to annonce that those dark times are about to end. A friend of mine (http://www.slr-corp.fr) worked with other people on this project during the summer to bring this functionality to Windows 10. Now let's see how we can do this.

First download the package here. (md5 : b7ed10bf8b8fbc312a7b35d2ffd0eef3)

Then you have to join Microsoft Insider Program.

When you are part of the insider program. You can now unzip the downloaded package (copy to your local disk) and run Install.cmd as administrator.

At this time you will need to restart your computer. When it's done, open a PowerShell prompt (as administrator) and change your execution policy (if not already done) to Bypass.

Set-ExecutionPolicByPass -Force

Then, you have to import the PS module, enable deduplication on volume and finally start the job.

You can follow the execution of the job with the command Get-DedupJob and have a status of savedspace and savingsrate with command Get-DedupVolume.

As you can see below, here the concrete result of deduplication. I have a folder with all my Hyper-V machines that normally would take 376 GB but thanks to deduplication, it only takes 81 GB.


Comments   

0 #70 Aenigma 2017-01-17 01:16
I learned something new. I had this working under version 14393. and had deduped a bunch of VMs. it was pretty sweet. Then i upgraded to build 15007. NOT so sweet. lost everything. Little tip. you might want to undedupe before an upgrade.

any details on how you build the package. i might want to try to rebuild it for 15007 before remaking all of the VMs.
Quote
0 #69 Arthur REMY 2017-01-08 15:29
Quoting wolkenloser:
Hi, Windows was updates to Build 14393.576. I have forgot to stop the Updates. Now I cant access to my Data Partion. Please can you Update the Datadeduplication ? ist it possible to Repair the data when I connect my deduplicated Disk on a windows2012 Server with deduplikation ?

Regards
Wolke


Hello,
The package is working with W10 build 14393.576, I am actually using it. Please verify that these services are running :
- Data Deduplication Service
- Data Deduplication Volume Shadow Copy Service
Quote
0 #68 Joachim Otahal 2016-12-31 12:15
Do you have a manual or how-to create the dedup package? I tried on my own a few times and failed...
Quote
0 #67 Joachim Otahal 2016-12-31 12:13
Quoting wolkenloser:
Hi, Windows was updates to Build 14393.576. I have forgot to stop the Updates. Now I cant access to my Data Partion. Please can you Update the Datadeduplication ? ist it possible to Repair the data when I connect my deduplicated Disk on a windows2012 Server with deduplikation ?

Regards
Wolke


Use a different Method: Activate Hyper-V.
Install Server 2016 (which you can get as 180 days test-version) in a virtual machine, install dedup there and update it.
And then attach the inaccessible disk to the virtual Server 2016.
You should be able to access and rescue your data that way.
If you have that partition on your system disk you are out of luck, you should unplug it, and install server 2016 on a spare disk to rescue your data.
I tested the dedup-package, but I didn't dare to actually use deduplication on real data since I feared exactly what happened to you.
Quote
0 #66 wolkenloser 2016-12-19 23:25
Hi, Windows was updates to Build 14393.576. I have forgot to stop the Updates. Now I cant access to my Data Partion. Please can you Update the Datadeduplication ? ist it possible to Repair the data when I connect my deduplicated Disk on a windows2012 Server with deduplikation ?

Regards
Wolke
Quote
0 #65 Matt 2016-12-04 09:44
Quoting Matt:
Now, for some reason, I can't access the data remotely via SMB.


Update: My Windows 10 clients appear to fine again now, but Android is still no good via SMB.
I am able to read the data via NFS and UPnP on all clients.
I was also able to access data that had not yet been touched by DeDup over SMB on Android without issue.

It may be just Android/SMB/DeDup combined which has the problems.
Quote
+1 #64 Matt 2016-12-01 14:49
This was all working perfectly for a few weeks.
I enabled this on volumes containing audio and video shares and was regaining a considerable amount of storage.
Now, for some reason, I can't access the data remotely via SMB. I can browse and see files but cannot read them. Small files appear to be fine but anything larger than 1MB or so cannot be read. The files work fine locally. If I copy them to a share on my "non-dedup" C the data is shared fine.
I have also tested sharing a directory junction link from the C drive but that just gives me the same result remotely.
I first noticed it happened with Android devices but after a few days it now happens on other Windows 10 computers. (My fiddling may be to blame here in my attempts to restore Android access...)
However, I can share the same files with a UPnP service which does not transcode the files and it all works. I haven't tested any other protocols.
Anyone else seen this issue or know of a solution?
Quote
0 #63 N-Tony 2016-11-29 08:33
Hey Folks, i have an issue. I installed your package as described and first everything went fine. I was very glad saving space. But after a few days, it wasn't possible to access data on my dedup volume. It always says file corrupt or to big. Please help me, because it's partially very important data like photos of my marriage etc and i forgot to make a backup before :sad:
Thank you in advance.
Quote
0 #62 Hardy 2016-10-15 01:20
The system automatically upgrades. . 14393 version Dedup can not be used, and now my version is 14931, to update it?
Quote
0 #61 TONSCHUH 2016-08-23 11:02
Quoting Jay B:
I just figured out that this was why my d: drive broke after the latest win 10 update. Thanks to TONSCHUH for putting on Mega. I don't see it mentioned but guess it's safe to say this should never be ran on the OS drive? As an update could break it.


It's not possible to use it on your OS-Drive. :-)
Quote

Add comment


Security code
Refresh

Who's Online

We have 16 guests and no members online

Twitter Flow


RT @POTUS: Thank you for everything. My last ask is the same as my first. I'm asking you to believe—not in my ability to create change, but…

iSCSI or SMB Direct, Which one is better? https://t.co/7Rz0MisbST

RT @MSLearning: Free #IT training, special exam offers, and more—anytime. 💥 Boom. https://t.co/RDCZVwHteT https://t.co/5JRQrt5IeY

Finally ! MP Update – Totally new Active Directory MP for Windows Server 2012 and 2016 https://t.co/BBW2rTIZOC

RT @MSHybridCloud: Watch how #MicrosoftIT transitioned from classic, on-premises #IT hosting to a #hybridcloud organization: https://t.co/8…
Follow Arthur REMY on Twitter