Stanford Talk on Flash Memory Design

Posted by VIOLIN SYSTEMS on Mar 15, 2012 3:36:34 PM

Back to school day.

Over at Stanford they have a speaker series that has been going on for the last few... decades, called the  Stanford University Department of Electrical Engineering Computer Systems Colloquium, known to many simply as EE380. The list of past speakers is as they say, long and distinguished, and includes such industry lightweights as Joy, Lamport, Colwell, Bechtolsheim, Gray, Metcalfe, Gelsinger, Hennessy, Patterson, Brin & Page, Diffie, Mashy, Wolfram, Cerf and Kay. For a mere mortal being invited to give an EE380 talk can be an intimidating experience, which they try to make easier by telling you that there will probably be no more than 50 people in the room, thankfully they didn't mention that 10,000 people will watch the web cast online until after my talk was over. Yes, the other day Bennett and Rowett were added to the list of "past EE380 speakers."

Read More

Topics: dedup, Flash Array, groomer, MLC, solid state drive, Computer Data Storage, flash memory, flash storage, garbage collection, grooming, IOPS, jon bennett, memory array, memory arrays, PCIe, server, SLC, SSD, Systems Design, Storage Array

Thoughts on DDUP and Compression from Violin Systems

Posted by VIOLIN SYSTEMS on Sep 7, 2011 2:39:24 PM

Lately I’ve been asked how data reduction technologies like DDUP and Compression should be applied to flash Memory Arrays. Both of these technologies promise more efficient use of storage by eliminating duplicate data, and thereby reducing the effective $/GB. To date, these technologies have largely been targeted at the backup and archival markets, where storing less data in the capacity disk tier is a big win in terms of space, power, etc. Products in this space basically throw a bunch of processing power, and for DDUP a lot of memory, add some very clever algorithms, and crunch the data to reduce its footprint. Now when applied to spinning disks the performance hit is pretty small when compared with the time it takes for disks to get anything done. What this means in practice is that even if your data doesn’t actually DDUP or compress all that well you probably won’t notice a difference. However, as with so much else, Flash changes the rules.

Read More

Topics: dedup, compression, software