Skip to content
Review Open access

Overview for Optimizing Data Structures for Efficient Big Data Handling

Aug 2026 · Social Science Research Network · 0 citations · 8 references

TL;DR

This study will examine the performance characteristics, optimization techniques, different algorithms, tools, methods, challenges and novel and extant data structures in order to enhance the handling, querying, and processing of large-scale datasets.

Abstract

The exponential growth of big data makes it harder to handle and process data in new ways. To handle these big, complicated files efficiently, you need data structures that are optimized and can make accessing, storing, and computing them quick. The goal of the paper is to look into different data structures so that handling big data is faster. Traditional data models often can't keep up with the needs of volume, velocity, and variety as data grows at an exponential rate. This study will examine the performance characteristics, optimization techniques, different algorithms, tools, methods, challenges and novel and extant data structures in order to enhance the handling, querying, and processing of large-scale datasets.

Read PDF

Similar papers

Open access 2026

Scalable Query Processing in Big Data Environments With Hadoop Distributed File System and Particle Swarm Optimization

A novel hybrid approach for efficient big data query processing through a two-phase approach that combines the parallel processing capabilities of HDFS Map-Reduce with the optimization power of PSO, contributing to an overall improvement in query processing efficiency for large-scale datasets.

S. Selvan, Gowri R. Punitha, V. V. Nathan et al. · 0 citations

Research on Mapreduce Based on Serverless Computing Platforms

This article aims to cope with the problem of high memory usage and low processing efficiency when computers process a large amount of data in the era of big data, and conducts research on MapReduce based on a serverless platform and finds that MapReduce is able to accurately measure the processing time, communication...

Zhong-Yu Xie · 0 citations
Open access Aug 2026

Efficient Storage and Query Optimization for Large-Scale Data Sets in Distributed Architectures

Experimental results demonstrate that the proposed optimization solution can effectively cut storage redundancy overhead, improve cluster resource utilization, drastically reduce query latency for large-scale data, and raise concurrent throughput.

Y.-G. Zhao · 0 citations
Review Open access Aug 2026

DATA WAREHOUSE OPTIMIZATION TECHNIQUES: A SURVEY OF QUERY PROCESSING, STORAGE, AND PERFORMANCE ENHANCEMENT METHODS

Data warehouses today are an essential part of existing Business Intelligence (BI) solutions, that collect data from multiple sources and enable analytical processing for strategic decision making. However, as enterprise data grows, and analytical queries become more complex, faster insights are demanded that present a...

Purushotham Jinka · 0 citations
Open access Oct 2026

Big Data analytic Tools and Technologies: It’s Applications and Challenges

Big data analytics involves the processing and analysis of vast and complex datasets to extract valuable insights and make effective decisions. Big data analytics faces several challenges related to data quality, privacy, integration, expertise, cost, and technology evolution. Conventional methods and infrastructures f...

C. Onyekwelu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.