DATA DUPLICATION REMOVAL USING FILE CHECKSUM
ABSTRACT
The file checksum technique is used in data duplication to quickly and accurately identify duplicate or redundant data. There is a possibility of inaccurate results, which can be avoided by comparing the checksum of the previously exiting file with the newly uploaded file.
Multiple attributes, such as file name, date and time, checksum, user id, and so on, can be used to store the file. When a user uploads new files, the system generates a checksum for the file and compares it to the checksum of a previously stored file. If a match is found, the old entry will be updated, otherwise a new entry will be created in the database.
Keywords: database, duplicate, entity, data, checksum, redundancy, user id
1. INTRODUCTION
Data is the collection of information. In the digital universe, data is constantly growing.
According to one study, by the end of 2020, each person will generate 1.7 megabytes of data. It is also clear that the rate of data production per day is approximately 2.5 quintillion bytes. Multiple backups of data or files by a single person are the reasons for the growth of multiple data.
Misapplications of social media.
The hacking of the organization’s system on 9/11 and the loss of data as a result of illegal activity demonstrated that data loss is a major problem for the organization.
This occurrence forces the organization to implement data back-up systems in order to protect their critical data. Organizations began to keep regular backups of their data, such as email, video, and audio, which increased their storage unit. When they back up their data on a regular basis, they end up storing duplicate data multiple times, which is a waste of storage.
As data volumes increase, storing and managing it becomes more difficult. More data necessitates more storage, which necessitates an increase in cost due to the need to upgrade the hardware or storage unit. Increasing the storage unit is not the solution because we don’t know how much storage we need to add. Increasing the number of storage units makes the system bulkier and more expensive.
As a result, the proper implementation of a data duplication removal system is the solution to the above problem.
If the data or file has not previously been stored, the data duplication removal method saves it to the system. If a match is found, the old entry will be updated. As a result, this system quickly removes duplicate data and saves valuable storage units.
Do You Have New or Fresh Topic? Send Us Your Topic
DATA DUPLICATION REMOVAL USING FILE CHECKSUM
INSTRUCTIONS AFTER PAYMENT
- 1.Your Full name
- 2. Your Active Email Address
- 3. Your Phone Number
- 4. Amount Paid
- 5. Project Topic
- 6. Location you made payment from