Storagebod Rotating Header Image

Corporate IT

Pestilential but Persistent!

There is no doubt that the role of the Storage Admin has changed; technology has moved on and the business has changed but the role still exists in one form or another.

You just have to look at the number of vendors out there jockeying for position; the existing big boys, the new kids of the block, the objectionable ones and the ones you simply want to file. There’s more choice, more decisions and more chance to make mistakes than ever before.

The day-to-day role of the Storage Admin; zoning, allocating LUNs, swearing at arcane settings, updating Excel spreadsheets and convincing people that it is all ‘Dark Magic’; that’s still there but much of it has got easier. I expect any modern storage device to be easily manageable on a day-to-day basis; I expect the GUI to be intuitive; I expect the CLI or API to be logical and I hope the nomenclature used by most players to be common. 

The Storage Admin does more day-to-day and does it quicker; the estates are growing ever larger but the number of Storage Admins is not increasing in-line. But that part of the role still exists and could be done by an converged Infrastructure team and often is. 

So why do people keep insisting the role is dead? 

I think because they focus on the day-to-day LUN monkey stuff and that can be done by anyone. 

I’m looking at things differently; I want people who understand business requirements who then turn these into technical requirements who can then talk to vendors and sort the wheat from the chaff. People who can filter bullshit; the crap that flies from all sides; the unreal marketing and unreal demands of the Business.

People who look at complex systems and can break them down quickly; who understand different types application interactions, who understand the difference between IOPS, latency and throughput.  

People who are prepared to ask pertinent and sometimes awkward questions; who look to challenge and change the status-quo. 

In any large IT infrastructure organisation; there are two teams who can generally look at their systems and make significant inferences about the health, the effectiveness and a difference to the infrastructure. They are often the two teams who are the most lambasted; one is the network team and the other the storage team. They are the two teams who are changing the fastest whilst maintaining a legacy infrastructure and keeping the lights on. 

The Server Admin role has hardly really changed…even virtualisation has little impact on the role; the Storage and Network teams are changing rapidly, many are embracing Software-Defined whilst the Industry is trying to decide what Software-Defined is.

Many are already pretty DevOps in nature; they just don’t call it that but you try to manage the rapid expansion in scale without a DevOps type approach. 

I think many in the industry seem to want to kill off the Storage specialist role; it is more needed than ever and is becoming a lot more key…you probably just won’t call them LUN Monkeys any more..they’ve evolved!

But we persist…

Reality is persistent

I see quite a few posts about this storage or that storage..how it is going to change everything or has changed everything. And yet, I see little real evidence that storage usage is really changing for many.  So why is this? 

Let’s take on some of the received wisdom that seems to be percolating around. 

Object Storage can displace block and file?

It depends; replacing block with object is somewhat hard. You can’t really get the performance out of it; you will struggle with the APIs especially to drive performance for random operations and partial updates.

Replacing file with object is somewhat easier, most unstructured data could happily be stored as object and it is. It’s an object called a file. I wonder how many applications even using S3  APIs treat Object Storage anything other than a file-store, how many use some of the extended metadata capabilities? 

In many organisations; what we want is cheaper block and file. If we can fake this by putting a gateway device in front of Object Storage; that’s what we will do. The Object vendors have woken up to this and that is what they are doing. 

But if a vendor can do ‘native’ file with some of the availability advantages of a well-written erasure coding scheme at a compelling price point, we won’t care.

And when I can boot from Object Storage..call me.   

All new developers are Object Storage aficionados?

I’m afraid from my limited sample size; I find this is rarely the case. Most seem to want to interact with file-systems or databases for their persistence layer. Now the nature of the databases that they want interact with is changing with more becoming comfortable with NoSQL databases.

Most applications just don’t produce enough data to warrant any kind of persistence layer that requires Object or even any kind of persistence layer at all.  

Developers rarely care about what their storage is; they just want it to be there and work according to their needs. 

Technology X will replace Technology Y

Only if Technology Y does not continue to develop and only if Technology X has a really good economic advantage. I do see a time when NAND could replace rotational rust for all primary storage but for secondary and tertiary storage; we might still be a way off. 

It also turns out that many people have a really over-inflated idea about how many IOPs their application need; there appears to be a real machismo about claiming that you need 1000s of IOPS…when our monitoring shows that someone could write with a quill pen and still fulfil the requirement. Latency does turn out to be important; when you do your 10 IOPS, you want it to be quick. 

Storage is either free or really cheap?

An individual gigabyte is basically free; a thousand of these is pretty cheap but a billion gigabytes is starting to get a little pricey.

A Terabyte is not a lot of storage? 

In my real life, I get to see a lot of people who request a terabyte of storage for a server because hell, even their laptop has this amount of storage. But for many servers, a terabyte is a huge amount of storage..many applications just don’t have this level of requirement for persistent data. A terabyte is still a really large database for many applications; unless the application developers haven’t bother to write a clean-up process.

Software-Defined is Cheaper? 

Buy a calculator and factor in your true costs. Work out what compromises you might have to make and then work out what that is worth to you. 

Google/Amazon do it, so we can too?

You could but is it really your core business? Don’t try to compete with the web-scale companies unless you are one..focus on providing your business with the service it requires. 

Storage Administration is dead?

It changed, you should change too but there is still a role for people who want to manage the persistent data-layer in all it’s forms. It’s no longer storage…it’s persistence.

Mine is the only reality?

I really hope not…

 

 

 

 

Skating with Cerberus

I imagine there was a sharp intake of breathe as Microsoft announced SQL Server for Linux and then a checking of dates. And yet it makes perfect sense, a very sensible strategic move for Microsoft.

My question and I know I’m not the only person asking this is; what is the future of Windows in the data-centre? If SQL Server runs well on Linux; there are a vanishing small number of workloads that I would want to run on Windows Server in a data-centre. Yes there are alot of third party applicatons that run on Windows and this is going to continue for many years but I do really wonder if Microsoft’s heart is really in the Windows Server business.

Microsoft appear to have decided that their future is in Cloud; not the Enterprise DC. I mean it’s always been questionable whether anyone sane would run Exchange and now you don’t have to; Office 365 takes care of that for you.

A lot of people like Azure and sure Microsoft would prefer you to run your cloud apps in Azure but if you want to run them elsewhere; they would like to still make money out of you. SQL Server on Linux will remove some of the friction for deployment in the Cloud.

SQL Server running on Linux also allows them to compete with Oracle in those data-centres that Windows is simply a grudging presence; there are certainly those who will have you believe that SQL Server is not Enterprise but many of those comments have been driven by the stigma of Windows. I work with DBAs who do both; for most workloads, SQL Server and Oracle are equally good.

So what’s left for Microsoft to do?

Well, if Microsoft announce AD Services running on Linux; you’ll really know that their heart is no longer in the Windows Data-centre.

2016 and Beyond…

Predictions are a mug’s game…the trick is to keep them as non-specific as possible and not name names…here are mine!

What is the future for storage in the Enterprise? 2016 is going to pan out to be an ‘interesting’ year; there’s company integrations and mergers to complete with more to come so I hear; cascading acquisitions seem likely as well.

There will IPOs; they will be ‘interesting’! People are looking for exits, especially from the flash market. A market that looks increasingly crowded with little to really tell between the players.

Every storage vendor is going to struggle with maintaining growth; technology changes has meant that it is likely that just to maintain current revenues that twice as much capacity is going to have to be shipped. Yet data efficiency improvements from thin-provisioning to compression to dedupe mean that customers are storing more data on less capacity.

Add in the normal year-on-year decline of the price of storage, this is a very challenging place.

Larger storage customers are becoming more mecurial about what they buy; storage administration has got so easy that changing storage vendors is not the big deal it used to be. The primary value these days of having some dedicated storage bods is that they should be pretty comfortable with any storage put in front of them.

As much as vendors like to think that we all get very excited by their latest bell or whistle; I’m afraid that we don’t any more. Does it make my job easier; can I continue to more with less or best case the same.

Data volumes do continue to grow but the amount of traditional primary data growth has slowed somewhat in my experience.

Data from instrumentation is a real growth area but much of this is transitory; collect, analyse, archive/delete…and as people start to see an ever increasing amount of money flowing to companies like Splunk expect some sharp intakes of breath.

Object Storage will continue to under-perform but probably less so. S3 will continue its rise as the protocol/API of choice for native object. Many file-stores will become object at the back-end but with traditional SMB/NFS front-ends. However, sync and share will make inroads formally into the enterprise space; products like Dropbox Enterprise will have an impact there.

Vendors will continue to wash their products in ‘Software Defined’ colours; customers will remain unimpressed. Open-source storage offerings will grow and cause more challenges in the market. Some vendors might decide to open-source some of their products; expect at least one large company to take this route and be accused of abandonware. And watch everyone try to change their strategy to match this.

An interesting year for many…so with that, I shall be off and wrap presents!

May you all have a Happy Christmas, a prosperous New Year and may your bits never rot!!

Waffle to burn?

NetApp have finally bitten the bullet and bought an AFA vendor; plumping for the technology driven Solidfire as opposed to some of the marketing driven competitors in the space.

At less than a billion dollars; it appears to be a very good deal for NetApp and perhaps with an ever decreasing number of suitors, it is a good deal for Solidfire and avoids the long march to IPO.

Obviously the whole deal will be painted as complementary to NetApp’s current product set but many will hope that Solidfire will long-term supplant the long-in-the-tooth OnTap. NetApp need to swallow their pride and need to move on from the past.

It can’t do this immediately; it needs work and it is not yet a solution for unstructured data. But putting data-services on top of it should not be a massive task as long as that is what NetApp decide to do and they don’t decide to try to integrate it with OnTap. NetApp can’t afford another decade of engineering faff! Funnily enough though , FC is seen as a relatively weak-point for Solidfire; where have we heard the before?

This could be as big a deal for them as EMC’s acquisition of Data General in 1999; the Clariion business brought some great engineers and a business that turned into a cash-cow for them. It allowed them to move into a different space and gave them options; it probably saved the company whilst they were messing up the Symmetrix line.

And whilst EMC/Dell are integrating themselves; NetApp have a decent opportunity to steal a march on their arch-rivals; especially if they take a light touch and continue to allow Solidfire to act like an engineering-led start-up.

I still have my doubts whether a storage-focused behemoth can actually survive long-term as data-centres change and buying behaviours change. But for the time being, NetApp have an interesting product again.

Interesting times for friends at both companies…

p.s anyone want to buy a pair of Solidfire socks?

Object Lessons?

I was hoping that one of the things that I might be able to write about after HPE Discover was that HPE finally had a great solution for Scale-Out storage; either NAS or Object.

There had been hints that something was coming; yes, HPe had done work with Cleversafe and Scality for Object Storage but the hints were that they were doing something of their own. And with IBM having taken Cleversafe into their loving bosom, HPE are the only big player without their own object platform.

Turns out however that HPE’s big announcement was their ongoing partnership with Scality; now Scality is a good object platform but there are bits that need work as is the case with Cleversafe and the others.

I don’t think that I am the only one is left disappointed by the announcement and the not the only person who was thinking…why didn’t they just buy Scality?

Are HPE still thinking of doing their own thing? Well, it’s gone very quiet and there’s some sheepish looking people about and some annoyed HPErs wondering when they will get their story straight.

Like HPE’s Cloud strategy; confusion seems to reign.

If there is any take-away from the first HPE Discover….it seems that HPE are discovering slowly and the map that is being revealed has more in common with the Mappa Mundi than an Ordinance Survey map…vaguely right, bits missing and centralised on the wrong thing.

Dude – You’re Getting An EMC

Just a few thoughts on the Dell/EMC takeover/merger or whatever you want to call it. 

  1. In a world where IT companies have been busy splitting themselves up; think HP, Symantec, IBM divesting from server business…it seems a brave move to build a new IT behemoth. 
  2. However; some of the restructuring already announced hints at a potential split in how Dell do business. Dell Enterprise to be run out of Hopkinton and using EMC’s Enterprise smarts in this space.
  3. Dell have struggled to build a genuine storage brand since going their different ways; arguably their acquisitions have under-performed.
  4. VMware is already under attack from various technologies – VMware under control of hardware server vendor would have been a problem a decade ago but might be less so as people have more choices for both virtualising Heritage applications and Cloud-Scale. VMware absolutely now have to get their container strategy right.
  5. EMC can really get to grips with how to build their hyper-converged appliances and get access to Dell’s supply chain. 
  6. That EMC have been picked up by a hardware vendor just shows how hard it is to transition from a hardware company to a software company. 
  7. A spell in purdah seems necessary for any IT company trying to transition their business model. Meeting the demands of the market seems to really hamper innovation and change. EMC were so driven by a reporting cycle, it drove very poor behaviours.
  8. All those EMC guys who transitioned away from using Dell laptops to various MacBooks…oh dear!
  9. I doubt this is yet a done deal and expect more twists and turns! But good luck to all my friends working at both companies! May it be better!

 

Overcoming Objections

My friend Enrico is a massive fan of Object Storage whereas for a long time, I’ve had the reputation of being somewhat sceptical; feeling the whole thing has been somewhat overhyped. The hype started with EMC’s Atmos launch and continued from there. 

The problem with Object Storage has been the lack of support from application vendors especially in the space that I work in. And development teams, especially those working in organisations with large numbers of heritage applications have been very slow to embrace it.  Most just want to work with standard filesystems.

And so we saw the birth of the cloud-gateway; devices that sat in front of the object-stores and presented the object-stores in a more familiar manner. Yet often the way that these were licensed simply added cost and negated the low cost of object store; they also added complexity into an environment.

The Object Storage vendors were slower to acknowledge the issue and really wanted you to use the API to access the storage; some of the larger vendors really didn’t want their Object Storage to cannibalise their NAS revenues and were even slower to acknowledge the issue.

So it seemed that Object Storage was really going to be confined to the world of cloud-scale and cloud-native applications. 

But this now seems to be rapidly changing; robust NFS implementations from the Object Storage vendors are becoming significantly more common; SMB implementations still seem to be rather patchy but once they become more robust, I see Object Storage becoming the standard for file-serving applications. 

Will we see API-driven ‘file access’ become the universal method for interacting with file storage? Not for some time but having the choice and realising that it is a not and all or nothing scenario will begin to ease friction in this space.  

 

A Slight Return

I intend to start updating here again occasionally as the itches begin to build up again and I feel the need to scratch. There’s a lot going in the industry and there’s a massive amount of confusion about where it’s going at the moment.

I’m having interesting conversations with industry figures, many of them are as confused privately as they are sure publicly. Few seem to know exactly how this all plays out and not just storage guys.

I had a conversation a couple of days ago that put the electricity supply model for compute back on the radar; the technology enablers are beginning to line up to make this much more feasible but is the will/desire there? This debate will carry on until we wake up and realise that it’s all changed again.

Flash and trash is still fascinating; vendors still playing games with pricing and comparisons that make little sense. Valuations out of control (maybe) and yet quite possibly we can see the time when flash does become the standard as the prices continue to fall and storage requirements continue to soar.

And a lastly, a big thanks to all those have offered support, prayers, kind thoughts to me over the past few months. It does help..watching people you love go through chemo isn’t fun but it does help reset your priorities a bit.

Scale-Out of Two?

One of the things I have been lamenting about for some time with many vendors is that there has been a lack of a truly credible alternative to EMC’s Isilon product in the Scale-Out NAS space. There are some technologies out there that could compete but they just seem to fall/fail at the last hurdle; there are also technologies that are packaged to look like Scale-Out but are cludges and general hotch-potches.

So EMC have pretty much have had it their own way in this space and they know it!

But yesterday, finally a company came out of Stealth to announce a product that might finally be the alternative to Isilon that I and others have been looking for.

That company is Qumulo; they claim to have developed the first Data-Aware Scale-Out NAS; to be honest that first bit, ‘Data-Aware’ sounds a bit like marketing fluff but Scale-Out NAS…that hits the spot. Why would Qumulo be any more interesting than the other attempts in the space? Well, they are based out of Seattle founded by a bunch of ex-Isilon folks; so they have credibility. I think they understand that the core of any scale-out product is scale-out; it has to be designed that way from the start.

I also think that they understand that any scale-out system needs to be easy to manage; the command and control options need to be robust and simple. Many storage administrators love the Isilon because it is simple to manage but there are still things that it doesn’t do so well; ACL management is a particular bugbear of many, especially those of us who have to work in mixed NFS/SMB environments (OSX/Windows/Linux).

If we go to the marketing tag-line, ‘Data Aware’; this seems to be somewhat equivalent to the Insight-IQ offering from Isilon but baked into the core product set. I have mentioned here and also to the Isilon guys that I believe that Insight-IQ should be free and a standard offering; generally, by the time that a customer needs access to Insight-IQ, it’s because there’s a problem open with support.

But if I start to think about my environment; when we are dealing with complex workflows for a particular asset, it would be useful to follow that asset; see what systems touch it, where the bottle-necks are and perhaps the storage where the asset lives are might well be the best place. It might not be that the storage is the problem but it is the one common environment for an asset. So I am prepared to be convinced that ‘Data Aware’ is more than marketing; it needs be properly useful and simple for me to produce meaningful reports however.

Qumulo have made the sensible decision that at day one, a customer has the option of deploying on their own commodity hardware or purchase an appliance from Qumulo. I’ll have to see the costs and build our own TCO model, let’s hope that for once it will actually be more cost effective to use my own commodity hardware and not have to pay some opt-out tax that makes it more expensive.

It makes a change to see a product that meets a need today…I know plenty of people who will be genuinely interested in seeing a true competitor to EMC Isilon. I think even the guys still at Isilon are interested; it pushes them on as well.

I look forward to talking to Qumulo in the future.

Stupid name tho’!!