• Home
• Topics
• Data reduction and deduplication
• What open-source data deduplication software options are available?

What open-source data deduplication software options are available?

Requires Free Membership to View

Login



When you register for SearchDataBackup.com, you’ll also receive targeted emails from my team of award-winning editorial writers. Because your job never seems to get any easier, it’s our goal to keep you up-to-date on the latest backup tips, trends and technologies that will help you get the job done.

Rich Castagna, Editorial Director

• E-mail Address: 

By submitting your registration information to SearchDataBackup.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchDataBackup.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

Oracle's Solaris ZFS is another popular open-source file system option, and they have recently announced support for data deduplication. According to their "Dedupe FAQ", ZFS eliminates duplicated blocks between files. The FAQ also says that the performance hit should be negligible as long as the deduplication tape is able to fit in RAM. However, it does not offer any guidance as to how big that table might grow.

For more information on data deduplication software:

• Read our data deduplication tutorial

• Learn about data deduplication software trends in backup and recovery

• Listen to our podcast on data deduplication and replication

• Watch W. Curtis Preston discuss data deduplication technology approaches

Dig Deeper

This was first published in February 2010

More from Related TechTarget Sites

• Solid State Storage
• Virtual Storage
• Cloud Storage
• Disaster Recovery
• Storage
• Storage UK
• Storage Channel

• searchSolidStateStorage

  • Pure Storage unveils FlashArray upgrade, customers

    Solid-state storage startup Pure Storage goes GA with its FlashArrays, upgrades software and reveals customers in its limited access program.

  • Fusion-io to collaborate with SCSI Trade Association on new standard

    Fusion-io Inc., announced this week that the company would work with the SCSI Trade Association on SCSI Express standard for PCIe-based storage.

  • Define SSD: Top terms you need to know

    How do you define SSD? Check out this list of important SSD terms. The list includes terms you should know and some that may seem obscure.

• Virtual Storage

  • "VMware Ready": Understanding what VMware-certified hardware designation means

    Expert Mike Laverick explains the concept of VMware Ready so listeners can gain a better understanding of what VMware-certified hardware means.

  • Virsto software adds support for XenDesktop VDI environments

    Seeing its technology as a good fit for solving VDI storage woes, Virsto Software extends its support to Citrix Systems’ XenDesktop VDI environments.

  • vSphere 5 storage: New storage management functionality, vSphere Storage Appliance

    In this interview, find out more about new vSphere 5 storage features and how they compare to vSphere 4’s, how the new vSphere Storage Appliance works, and the latest on vStorage APIs.

• CloudStorage

  • Creating a private cloud environment offers cost savings, scalability

    Creating a private cloud can bring cost savings, scalability and self-service, but the transformation may involve moving to object storage.

  • How open source "Swift" OpenStack Object Storage works

    MercadoLibre’s "Swift" OpenStack Object Storage makes use of clusters of commodity servers to store typically static data; MD5 hash algorithm assigns unique identifiers to files.

  • MercadoLibre blazes open source cloud storage trail using OpenStack

    MercadoLibre blazes open source cloud storage trail using OpenStack components for object storage, block storage and computing to set up a private cloud infrastructure.

• searchDisasterRecovery

  • Financial firm replicates way to lower recovery time objective

    Financial services firm overhauls data protection to meet recover time objectives and recovery point objectives.

  • Recovery planning inches forward, according to recent DR research

    This tip examines several examples of DR research from independent sources and DR vendors.

  • Leverage government cybersecurity programs

    This tip examines some key government cybersecurity initiatives and their relevance to the private sector.

• searchStorage

  • Storage Radio: New EMC VMAX, XtremIO bought; Symantec customers riled

    Storage Radio: Listen to this week’s storage headlines, including EMC’s new VMAX 40K, its acquisition of XtremIO and Symantec user backlash.

  • Understanding storage in the Hadoop cluster

    Of all the ways to handle the storage requirements of 'big data' analytics, the Hadoop cluster is receiving the most attention. Find out why.

  • Managing big data: Petabytes, exabytes and analytics

    Learn the differences between managing big data and traditional data warehousing. We'll also explore big data analytics, MapReduce and Hadoop.

• searchStorageUK

  • Symantec: Mobile devices, cloud gaining traction

    Symantec study finds widespread use of mobile devices, cloud and virtualization while DR planning still lags.

  • Execs talk Backup Exec 2012, integrated appliances at Symantec Vision

    Our senior news director Dave Raffo attended Symantec Vision last week, and we have compiled his reporting for your convenience.

  • Near-line storage in the cloud: service levels, document collaboration

    Near-line storage in the cloud is the topic of this expert podcast. Learn how various cloud solutions allow for document collaboration and what service levels to expect.

• searchStorageChannel

  • EMC confirms XtremIO acquisition

    Headlines: EMC confirms that it acquired flash array startup XtremIO, and Israeli publication Globes pegs the deal at $430 million.

  • The pros and cons of cloud backups for storage resellers

    In this interview, see the pros and cons of cloud backup compared with tape backup, as well as how storage VARs can take advantage of that to guide their customers in the move to the cloud.

  • HIPAA-compliant cloud storage services: Due diligence is key to survival

    To provide HIPAA-compliant cloud storage services, storage VARs and MSPs face many, grave regulatory requirements. Learn about the risks and get advice for performing due diligence.

• About us
• Contact us
• Site index
• Privacy policy
• Advertisers
• Business partners
• Events
• Media kit
• TechTarget corporate site
• Reprints
• Site map