Efficient Data Storage Management using Deduplication

  • Pooja Kashinath Pinjare, Poonam Gupta, Shaikh Zohra Anzar

Abstract

This paper presents a Deduplication storage system over desktop computing. Data Deduplication is one of the popularly used data compression techniques. It is used for finding and deleting repeated copies of data and has been mostly used now in a big storage system to reduce the storage space of the system. Day by day the storage system problem is increases tons to avoid the repeated storing of file Deduplication concept is used. The process of finding duplicate data from the storage systems to avoid the storage problem which happens due to the repeated storage of files is called Deduplication. This system is employed to enhance storage management. The proposed system provides the efficient storage management with finding the duplicates data which are having a similar hash code i.e. the data which are repeated within the system. To seek out duplicate data from the system MD5 hashing is used. MD5 is the hashing algorithm. The proposed system takes the file hash code to urge the precise duplicate file. Firstly the database creation is completed during which all the folders get scan and hash code of its store within the database. Once the database is prepared then the user can get upload the new file within the system then the hash code of that file is calculated and generated hash code is matched with the database record if the hash code matches then the system will give the message file is duplicate with the file name and path of that file. If the file isn't duplicate then the path and hash code of that file is a store within the database and file store at in specified location.

Published
2020-06-06
How to Cite
Pooja Kashinath Pinjare, Poonam Gupta, Shaikh Zohra Anzar. (2020). Efficient Data Storage Management using Deduplication. International Journal of Advanced Science and Technology, 29(04), 8971 -. Retrieved from http://sersc.org/journals/index.php/IJAST/article/view/30679