News


The Jim Pinto Column: Big Data and chaotic ­storage

July 2014 News

The term ‘Big Data’ was coined in 2008 and caught on quickly as a blanket term for any collection of data sets so large and complex that it becomes difficult to process using traditional data processing applications.

Big Data is being generated by everything around us at all times. Every digital process and social media exchange produces it. Systems, sensors and mobile devices transmit it. Big Data arrives from multiple sources at high speed, huge volume and variety. To extract meaningful value from big data requires optimal processing power, analytics capabilities and skills.

Analysing Big Data is becoming a key competitive advantage, generating waves of productivity growth, innovation and consumer surplus. Every business will have to grapple with the implications. The increasing amount and detail of information captured by enterprises, the rise of multimedia and social media and the Internet of Things will fuel exponential growth.

McKinsey Research reports that Big Data is now an important factor of production, along with labour and capital. By 2009, every company with more than 1000 employees, in nearly all sectors in the US economy, already had an average of 200 terabytes of stored data per company.

There are five broad ways in which using Big Data can create value:

1. Unlock significant value by making information transparent and usable at much higher speed.

2. As organisations create and store more transactional data in digital form, they can collect more accurate and detailed performance information on everything, to expose variability and boost performance.

3. Big Data allows ever-narrower segmentation of customers and much more precisely tailored products and services.

4. Big Data analytics can substantially improve decision-making.

5. Big Data can be used to improve the development of the next generation of products and services.

The use of Big Data will become a key basis of competition and growth. Every company needs to take Big Data seriously. In most industries, established competitors and new entrants alike will leverage data-driven strategies to innovate, compete and capture value from wide ranging, deep and real-time information.

McKinsey predicts that there will be a shortage of talent necessary for organisations to take advantage of Big Data.

Several issues will have to be addressed to capture the full potential of Big Data. Policies related to privacy, security, intellectual property and even liability will need to be addressed in a Big Data world.

Organisations need not only to put the right talent and technology in place but also structure workflows and incentives to optimise the use of Big Data.

Amazon warehouse automation

I hate shopping and I’m an Amazon nut – I buy everything via Amazon, the world’s largest online retailer. My selection arrives on my doorstep within just a couple of days.

Do you wonder how Amazon manages to deliver any of the huge variety of products to your doorstep so cheaply and so quickly? What does it cost them to put all those items on the shelf, select them unerringly and deliver them so quickly?

Amazon delivers from 80 giant warehouses, strategically located near key shipping hubs around the world. At the heart of this global operation are people and a logistics system known as ‘chaotic storage’ which is like organised confusion. It is an organic shelving system without permanent areas or sections. There is no area just for books, or any specific products, as you might expect in a retail store layout. The product’s characteristics and attributes are irrelevant. What is important is the unique barcode associated with every product that enters the warehouse.

Every single shelf space inside an Amazon warehouse has a barcode. Every incoming product that requires storage is assigned a specific barcode that matches the shelf space in which it will be stored, allowing free space to be filled quickly and efficiently.

There are several key advantages to the chaotic storage system. The first is flexibility – freed-up space can be refilled immediately. Next is simplicity – new employees don’t need to learn where products are located; they simply need to find the storage shelf within the warehouse. They don’t need to know what the product is, just where it is.

Last is optimisation. Amazon must handle many millions of orders, which means that at any given moment there is a long list of products that need to be picked from the shelves and prepared for shipment.

Since Amazon deals with such a wide variety of products there are a few exceptions to the rule. Really fast-moving articles do not adhere to the same storage system since they enter and leave the warehouse so quickly. Really bulky and heavy products still require separate storage areas and perishable goods are not ideal for obvious reasons.

With this storage system a wide variety of products can be found located next to each other – a necklace could be located beside a DVD and underneath a set of power tools.

It’s a fascinating system and chaotic storage is the best way to describe it.

Jim Pinto is a technology futurist, international speaker and automation industry commentator. You can e-mail him at [email protected]

Or review his prognostications and predictions on his website www.jimpinto.com





Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Helping mines get results from water improvements
News
South African mines operate under constrained, water-scarce conditions where every investment must be justified. Xylem’s Chetan Mistry explains how the right water technology partner helps mines prioritise high-value water systems across the mining lifecycle.

Read more...
From solar to water, onsite plants are the next big industrial resilience shift
News
South African industrial operators who secured their energy supply with onsite solar generation now face the same imperative with water. Robert Erasmus of Sanitech argues that onsite water treatment is the next essential pillar of business continuity.

Read more...
From the editor's desk: Pushing engineering to the limit
Technews Publishing News
Among the many things robots can do, it’s a lot of fun to follow how fast they are. They go from the Boston Dynamics cheetah, which first reached a record-breaking speed of 45,5 km/h, to the robot Charlie ...

Read more...
Schneider Electric concludes Innovation Summit Middle East and Africa
Schneider Electric South Africa News
Schneider Electric's Innovation Summit Middle East and Africa, held in Abu Dhabi with more than 2500 attendees, explored the convergence of energy, AI and industrial software, launched an Industrial AI study and announced the NEST Accelerator Programme for energy and industrial tech startups.

Read more...
VEGA brings measurement expertise beyond mining to Electra Mining Africa 2026
VEGA Controls SA News
VEGA used its Electra Mining Africa 2026 stand to demonstrate that its level and pressure measurement instruments extend well beyond mining, covering water, food and beverage, pharmaceuticals, chemicals, and oil and gas applications across the continent.

Read more...
Sustainable solutions for sugar
Bearing Man Group t/a BMG News
BMG received a Special Commendation Exhibition Stand Award at the South African Sugar Technologists’ Association Congress, where it showcased an integrated turnkey drive solution designed to simplify the upgrading of ageing crushing-mill drive systems.

Read more...
Measure, Manage, Maintain: The operating model behind SA’s water resilience
Siemens South Africa News
South Africa’s growing water crisis is putting pressure on infrastructure, municipalities and the economy. Siemens highlights how digital technologies, smarter operations and safe water reuse could help shift the country from crisis response towards a more resilient and sustainable water future.

Read more...
VEGA brings measurement expertise beyond mining to Electra Mining Africa 2026
VEGA Controls SA News
VEGA used its Electra Mining Africa 2026 stand to demonstrate that its level and pressure measurement instruments extend well beyond mining, covering water, food and beverage, pharmaceuticals, chemicals, and oil and gas applications across the continent.

Read more...
Schneider Electric concludes Innovation Summit Middle East and Africa
Schneider Electric South Africa News
Schneider Electric’s Innovation Summit Middle East and Africa, held in Abu Dhabi with more than 2500 attendees, explored the convergence of energy, AI and industrial software, launched an Industrial AI study and announced the NEST Accelerator Programme.

Read more...
RX Africa and Messe Muenchen India join forces to strengthen business platforms in Africa
RX Africa News
Messe Muenchen India has announced a strategic partnership with RX Africa to strengthen the scale, reach and market impact of its premier co-located trade fairs, analytica Lab Africa and IFAT Africa, ahead of their 2027 editions.

Read more...









While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd | All Rights Reserved