Skip to main navigation menu Skip to main content Skip to site footer
Español (España) | English
Editorial
Revistas / Journals
Salud, Ciencia y Tecnología Metaverse Basic and Applied Research Data & Metadata Interdisciplinary Rehabilitation Salud, Ciencia y Tecnología - Serie de Conferencias Community and Interculturality in Dialogue Seminars in Medical Writing and Education Health Leadership and Quality of Life Gamification and Augmented Reality Southern perspective / Perspectiva austral
Home
Issue
Current Issue Previous Issues Special Issue
About
About the Journal Editorial Team Privacy Statement Digital preservation policy Contact
Submissions
Author Guidelines Peer Review Process Ethical aspects Open Access Policy and Copyright Anti-plagiarism policy Crossmark policy page
Indexing
×
Español (España) | English
Editorial

Salud, Ciencia y Tecnología Metaverse Basic and Applied Research Data & Metadata Interdisciplinary Rehabilitation Salud, Ciencia y Tecnología - Serie de Conferencias Community and Interculturality in Dialogue Seminars in Medical Writing and Education Health Leadership and Quality of Life Gamification and Augmented Reality Southern perspective / Perspectiva austral
Home

Current Issue Previous Issues Special Issue

About the Journal Editorial Team Privacy Statement Digital preservation policy Contact

Author Guidelines Peer Review Process Ethical aspects Open Access Policy and Copyright Anti-plagiarism policy Crossmark policy page
Indexing
Original
Published: 2024-03-30
DOI: https://doi.org/10.56294/dm2024245

Big Data De-duplication using modified SHA algorithm in cloud servers for optimal capacity utilization and reduced transmission bandwidth

By
Rajendran Bhojan ,
Rajendran Bhojan

Department of Mathematics and Computer Science, The Papua New Guinea University of Technology

Search this author on:

PubMed | Google Scholar
Manikandan Rajagopal ,
Manikandan Rajagopal

Lean Operations and Systems, School of Business and Management, CHRIST (Deemed to be University), Bangalore, India

Search this author on:

PubMed | Google Scholar
Ramesh R ,
Ramesh R

Department of Computer Science, KPR College of Arts Science and Research, Tamilnadu, India

Search this author on:

PubMed | Google Scholar

Abstract

Data de-duplication in cloud storage is crucial for optimizing resource utilization and reducing transmission overhead. By eliminating redundant copies of data, it enhances storage efficiency, lowers costs, and minimizes network bandwidth requirements, thereby improving overall performance and scalability of cloud-based systems. The research investigates the critical intersection of data de-duplication (DD) and privacy concerns within cloud storage services. Distributed Data (DD), a widely employed technique in these services and aims to enhance capacity utilization and reduce transmission bandwidth. However, it poses challenges to information privacy, typically addressed through encoding mechanisms. One significant approach to mitigating this conflict is hierarchical approved de-duplication, which empowers cloud users to conduct privilege-based duplicate checks before data upload. This hierarchical structure allows cloud servers to profile users based on their privileges, enabling more nuanced control over data management. In this research, we introduce the SHA method for de-duplication within cloud servers, supplemented by a secure pre-processing assessment. The proposed method accommodates dynamic privilege modifications, providing flexibility and adaptability to evolving user needs and access levels. Extensive theoretical analysis and simulated investigations validate the efficacy and security of the proposed system. By leveraging the SHA algorithm and incorporating robust pre-processing techniques, our approach not only enhances efficiency in data de-duplication but also addresses crucial privacy concerns inherent in cloud storage environments. This research contributes to advancing the understanding and implementation of efficient and secure data management practices within cloud infrastructures, with implications for a wide range of applications and industries.

Keywords:

Preprocessing,
De-duplication,
SHA,
Cloud Servers,
Target,

How to Cite

1.
Bhojan R, Rajagopal M, R R. Big Data De-duplication using modified SHA algorithm in cloud servers for optimal capacity utilization and reduced transmission bandwidth. Data and Metadata [Internet]. 2024 Mar. 30 [cited 2024 Jul. 3];3:245. Available from: https://dm.saludcyt.ar/index.php/dm/article/view/245

Copyright Notice

The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.

Article metrics

Google scholar: See link

Metrics

Metrics Loading ...

Vol. 3 (2024)
See full issue

The statements, opinions and data contained in the journal are solely those of the individual authors and contributors and not of the publisher and the editor(s). We stay neutral with regard to jurisdictional claims in published maps and institutional affiliations.