Why is flash good for data warehousing?

Posted by VIOLIN SYSTEMS on Apr 26, 2013 12:41:10 PM

Flash is about latency and IOPs so why would it be good for Data Warehousing or Business Intelligence?

Excellent question.  Yes, the typical marketing and wow-factor stats around flash are based on latencies and IOPs (Input Output Per Second).  Data warehousing (DW) and Business Intelligence (BI) is normally a throughput game, so what gives?

Read More

Topics: MySQL, Oracle, BI, Big Data, Business Analytics, Business Intelligence, data warehouse, database, ETL, flash, flash storage, reporting, SSD, Sybase, SQL Server

Flash for Transactional Workloads

Posted by VIOLIN SYSTEMS on Apr 26, 2013 12:41:01 PM

Transactional workloads are commonly defined as being small atomic pieces of work.  This is in contrast to decision support, Data Warehouse, Business Intelligence or otherwise labeled reporting systems that require fewer, larger, more sequential workloads.  Updates, inserts, deletes and even small result-set selects are all included in OLTP, transactional efforts.

Read More

Topics: OLTP, Oracle, flash, flash storage, SSD, SQL Server, transactional

Stanford Talk on Flash Memory Design

Posted by VIOLIN SYSTEMS on Mar 15, 2012 3:36:34 PM

Back to school day.

Over at Stanford they have a speaker series that has been going on for the last few... decades, called the  Stanford University Department of Electrical Engineering Computer Systems Colloquium, known to many simply as EE380. The list of past speakers is as they say, long and distinguished, and includes such industry lightweights as Joy, Lamport, Colwell, Bechtolsheim, Gray, Metcalfe, Gelsinger, Hennessy, Patterson, Brin & Page, Diffie, Mashy, Wolfram, Cerf and Kay. For a mere mortal being invited to give an EE380 talk can be an intimidating experience, which they try to make easier by telling you that there will probably be no more than 50 people in the room, thankfully they didn't mention that 10,000 people will watch the web cast online until after my talk was over. Yes, the other day Bennett and Rowett were added to the list of "past EE380 speakers."

Read More

Topics: dedup, Flash Array, groomer, MLC, solid state drive, Computer Data Storage, flash memory, flash storage, garbage collection, grooming, IOPS, jon bennett, memory array, memory arrays, PCIe, server, SLC, SSD, Systems Design, Storage Array

Part 4: SSD’s in Storage Arrays

Posted by VIOLIN SYSTEMS on Jan 10, 2012 2:41:35 PM

Why did we take disk drives out of servers?  Now we rely on traditional disk array storage and surround it with data center compute.  The industry doubles processing power every 12 to 18 months and Gigabit Ethernet and Infiniband now provide 10 – 40Gig bandwidth with very low latencies.  So we have lots of compute and we are swimming in bandwidth but the storage array hasn’t evolved at even 1/100 the pace?  The lack of IO is killing the applications.

Now in 2012 it seems clear that solid state storage will be the solution to balance the network-compute-storage triangle and provide the IO necessary to not only virtualize the easy applications but now tackle the hard (latency-sensitive) IO bound applications that have been fine tuned to run on dedicated servers.

Read More

Topics: flash memory, flash storage, SSD, Storage Array