Storagebod Rotating Header Image

Flash Changed My Life

All the noise about all flash arrays and acquisitions set me thinking a bit about SSDs and flash; how it has changed things for me.

To be honest, the flash discussions haven’t yet really impinged on my reality in my day-to-day job, we do have the odd discussion about moving metadata onto flash but we don’t need it quite yet; most of the stuff we do is sequential large I/O and spinning rust is mostly adequate. Streaming rust i.e tape is actually adequate for a great proportion of our workload. But we keep a watching-eye on the market and where the various manufacturers are going with flash.

But flash has made a big difference to the way that I use my personal machines and if I was going to deploy flash in a way that would make the largest material difference to my user-base, I would probably put it in their desktops.

Firstly, I now turn my desktop off; I never used to unless I really had to but waiting for it to boot or even awake from sleep was at times painful. And sleep had a habit of not sleeping or flipping out on a restart; turning the damn thing off is much better. This has had the consequence that I now have my desktops on an eco-plug which turns off all the peripherals as well; good for the planet and good for my bills.

Secondly, the fact that the SSD is smaller means that I keep less crap on it and am a bit more sensible about what I install. Much of my data is now stored on the home NAS environment which means I am reducing the number of copies I hold; I find myself storing less data. There is another contributing factor; fast Internet access means that I tend to keep less stuff backed-up and can stream a lot from the Cloud.

Although the SSD is smaller and probably needs a little more disciplined house-keeping; running a full virus check which I do on occasion is a damn sight quicker and there are no more lengthy defrags to worry about.

Thirdly, applications load a lot faster; although my desktop has lots of ‘chuff’ and can cope with lots of applications open, I am more disciplined about not keeping applications open because their loading times are that much shorter. This helps keeping my system running snappily, as does shutting down nightly I guess.

I often find on my non-SSD work laptop that I have stupid numbers of documents open; some have been open for days and even weeks. This never happens on my desktop.

So all-in-all; I think if you really want bang-for-buck and to put smiles on many of your users’ faces; the first thing you’ll do is flash-enable the stuff that they do everyday.

 

 

#Storagebeers, SNIA Stuff

I posted a whilst ago giving early warning about a #storagebeers event in London.

This event will be Wednesday 23rd  May whilst most of the EMC storage world is partying in Vegas and having a great time (who knows, maybe one day I’ll work out how to get there). But we’ll hopefully also be having a good time as well in London.

1) It is Data Centre  Technology Academy time during the day;  come and heckle Alex McDonald or give him generous support as he works his way through a vendor-neutral presentation trying not to abuse his competitors. Always marvellous fun.

2) And then it will be London #storagebeers; Princess of Prussia is my proposed venue as it’s just a little walk from the DCTA venue. Hopefully then we’ll go and find somewhere to have a curry. I’m hoping we can get into Cafe Spice Namaste but failing that, we should be able to wander up the road and go to the Halal.

I’ve also been doing a little bit of work with SNIA Europe around how we get a bit more community involvement with SNIA and get more than the vendors involved. Please go here for the first SNIA Europe Blogger page/question…

 

 

 

 

Long Term Review: Synology DS409

Over the past three years, my primary home NAS has been the Synology DS409; in this time, I’ve built my own NAS solutions as well and have trialled a number of home-build solutions but my core home NAS remains the DS409.

When I bought the DS409, I looked and considered a number of competing solutions; Drobo and QNAP boxes came highly recommended and there are still plenty of people who swear by them.

The build quality of the DS409 is excellent and still looks pretty much good as new but then again it is not as it I am kicking it across the room on a regular basis. I give it regular clean-out with compressed air, just to blow the dust out of the fans; it still runs quiet and cool.

It currently has 4x1Tb Western Digital drives in a RAID-5 format; it has an additional e-SATA drive attached to it to provide additional storage. These are carved up to provide NFS, SMB and iSCSI shares.

As well as providing traditional file-sharing capability, it is also the print server for the house and also works as a DNLA and an Airplay server. If I didn’t have a separate web-server, VPN server etc; it could also do that for me.

You can integrate into an Active Directory domain if you so wish and you have a variety of options for backing up; you can use an rsync-based back-up solution, back-up in to the s3 Cloud or simply back-up to a locally attached external disk.

Synology continue to support and update the DS409 with firmware and features; the feature-set is constantly being improved features like Synology Hybrid RAID which allows mixed sized drives to be used in a similar way to the Drobo; to CloudStation which enabled your Synology device to work as a private Cloud-storage device.

Synology are constantly improving their software and it is fairly admirable that they continue to update their software for products which they no longer sell. The user interface has improved significantly over time; it is simple and intuitive and if you need to, you can always drop back into the Linux command-line. Having access to the Linux command line means that there are a number of third party applications which can also be installed, it is a very hacker-friendly box.

The only thing it really lacks, is significant integration with VMware but most home-users and probably most small businesses will not miss this at all.

When the time comes to replace my home NAS, Synology will be top of my list.

Highly recommended.

Death of the Home Directory

Well, when I say that the Home Directory is dying; I mean that it is probably moving and with it some problems are going to be caused.

As I wander round our offices, I often see a familiar logo in people’s system trays; that of a little blue open box. More and more people are moving their documents into the Cloud; they really don’t care about security, the just want the convenience of their data where ever they are. As the corporate teams enforce a regime of encryption on USB flash-disks; everyone has moved onto Cloud-based storage. So yes, we are looking at ways that we can build internal offerings which bring the convenience but feel more secure. Are they any more secure? And will people use them?

I suspect that unless there are very proscriptive rules which block access to sites such as Dropbox, Box, Google Drive and the likes; this initiative will completely fail. The convenience of having all your data in one place and being able to work on any device will over-ride security concerns. If your internal offering does not support every device that people want to use; you may well be doomed.

And then this brings me onto BYOD; if you go down this route and evidence suggests that many will do so..you have yet more problems. Your security perimeter is changing and you are allowing potential hostile systems onto your network; in fact, you always probably did and hadn’t really thought about it.

I have heard of companies who are trying to police this by endorsing a BYOD policy but insisting that all devices should be ‘certified’ prior to being attached to the corporate network. Good luck with that! Even if you manage to certify the multitude of devices that your staff could turn up with as secure and good to go; that certification is only valid at that point or as long as nothing changes, no new applications installed, no updates installed and probably no use made of the device at all.

Security will need to move to the application and this could mean all of the applications; even those familiar applications such as Word and Excel. Potentially, this could mean locking down data and never allowing it be stored in a non-encrypted format on a local device.

The responsibility for ensuring your systems are secure is moving; the IT security teams will need to deal with a shifting perimeter and an increasingly complicated threat model. Forget about updating anti-virus and patching operating systems; forget about maintaining your firewall; well don’t but if you think that is what security is all about, you are in for a horrible shock.

 

Big Data Values for All?

The jury is probably still out on the real value of ‘Big Data’ and what it will mean to our lives; whether it is a power for good or ill or even if it is a power for anything is probably still up for debate. But there is one thing which is probably true, ‘Big Data’ will change data-processing for the better.

At present, you will find that the prevailing wisdom is that if you have Data to store, you should store it in a relational database but the ‘new’ data processing techniques which ‘Big Data’ brings to the party changes this or at least seriously questions this wisdom.

I know many applications that currently store their data into relational databases that could possibly benefit from a change of focus; these are often log-oriented applications which are only using one or two tables to store their Data and often the indexes to enable fast processing are larger than the data stored.

So even if you have no ‘Big Data’, you may find that you have more candidates than you realise for ‘Big Data’ processing techniques….and I suspect this is what really scares our friends at Oracle. For too long now, serious Data processing required serious relational databases and that road took us into the realms of Oracle; increasing costs and infrastructure complexity.

The problem is that re-writes show little immediate business value and the investment will take two or three years to pay-off; it is this that your RDMS account manager is counting on. Yet as soon as you start to factor in maintenance, upgrade and recurring costs; this should be an economic no-brainer for the IT Manager with foresight.

 

 

No Pain, No Gain?

I always reserve my right to change my mind and I am almost at the stage that I have changed my mind on blocks/stacks or whatever you want to call them? And for non-technical and non-TCO related reasons.

I think in general componentised and commodity-based stacks make huge sense; whether you are building out private or a public infrastructure; a building block approach is the only really scalable and sustainable approach. And I wrote internal design documents detailing this approach eight or nine years ago; I know I’m not the only one and we didn’t call it cloud…we called it governance and sensible.

But where I have changed my opinions is on the pre-integrated vendor stacks; I think that they are an expensive way of achieving a standardised approach to deploying infrastructure and I have not changed from this opinion.

However I think that this cost may well be the important catalyst for change; if you can convince a CFO/CEO/CIO/CTO etc that this cost is actually an investment but to see a return on the investment that you need to re-organise and change the culture of IT, it might well worth be paying.

If you can convince them that without the cultural change, they will fail….you might have done us all a favour. If it doesn’t hurt, it probably won’t work. If it is too easy to write things off when it’s tough…it’ll be too easy to fall back into the rut.

So EMC, VCE, Cisco, IBM, NetApp, HP etc….make it eye-wateringly expensive but very compelling please. Of course, once we’ve made the hard yards, we reserve the right to go and do the infrastructure right and cheap as well.

Archicultural….

It seems the more that I consider the architectural and technical challenges and changes to the Corporate IT world, the more I come back to the cultural issues which exist within many IT departments and the more I find myself feeling strongly that this is where the work really needs to be done.

Unfortunately it is pretty hard to buy a culture from a vendor, even though I suspect if Chuck could work out exactly how to do so; we’d have a product from EMC called V-CLT (or is that VMware?); so building a culture is going to be have to be an internal thing and that means it is going to be tough.

Too often the route into IT Management means either promoting excellent techies into management or sometimes promoting people into positions where they can do no more harm as opposed to moving people into positions which suits them and their personalities. I am sure that we can all think of examples of both; this is especially true in end-user organisations as the career paths are less varied than that of the vendor organisation. Vendor organisations have sales, marketing and other avenues for progression; they also have the traditional IT paths as well.

But all IT organisations are suffering from cultures which neither scale or are sustainable in the long term. There needs to be a long term shift which ensure that training and development are in more than just technical skills; there needs to be a move away from a hero culture that sees staff at all levels of an organisation regularly halving their hourly rates by working longer than their contracted hours, not taking leave and forgetting that you ‘Work to Live’.

Careers need to be thought of more than the fastest route to the top and when people find their natural level; this does not mean that they do not stop being valuable members of an organisation. Work on developing people horizontally (and you with the dirty mind can stop sniggering); I think that there is something relatively unhealthy when you find managers who have worked their way up through a team and only worked in one team.  Horizontal moves have immense value; I have learnt such a lot in the past couple of years running a test team as well as a storage team.

Horizontal moves will help to break down some of the siloed mentality; even if you do not believe in DevOps, moving people between these two disciplines even on secondment must have value.

If you have a graduate scheme in place, the natural roles that most graduates gravitate to are in development; make sure that they have a placement in an Operations/Infrastructure team. They will learn so much.

And if you work in management; you are doing a pretty hard job, make it easier on yourself by standing on the shoulders of giants and actually study the art of management and leadership. Most get to management by being good at something; being good at that something does not mean you know anything about management.

Politics, Practicality, Principles and Pragmatism

Many IT infrastructure decisions are made for reasons which have little to do with the capability of the technologies and very few are even made with due consideration of investment returns, long term costs and even fewer are revisited with the light of truth shone upon them.

So it is a wonder that any IT infrastructure works at all?

Well not really, as we have moved into a pretty much homogenised environment where all is interchangeable and pretty much all is good enough; the decisions are going to be made for reasons other than technology.

Many decisions are made simply are the grounds that more of the same is the path of least resistance. You have already learnt to love what you hated about a product and you are comfortable with it.  You might have grown close to the account team, they know all your favourite restaurants and sporting events; why change? And change is costly.

Of course, then you get the obverse; you have learnt to hate what you loved and the account team has grown far too comfortable. Perhaps there’s been a change in account manager or simply you decide that you’ve spent too much money with a company. Of course at this point, you suddenly find that what you have been paying is far too much and the incumbent slashes their costs to keep the account. But you’ve had enough and you decide to change.

Then you get the principled decision; the decision which could be based on the belief that open-source is the right thing to do or perhaps you believe the security through obscurity myth. Sometimes these look like technological decisions but they are really nothing to do with technology in general.

So have we moved to a market where the technology is pretty much irrelevant and why?

I think that we have and for a pretty good reason; you can’t manage what you can’t measure and quite simply, we are still lousy in measuring what we do and what it means. It means that all decisions have to made based on reasons which often have dubious links with reality.

For all discussions about metering and service-based IT; I don’t believe that we are anywhere near it. Internal metering tools are often so expensive and invasive to implement that we don’t bother.

And what is worse, we are often working in environments which do not care really care; who really cares if solution ‘X’ is cheaper over five years than solution ‘Y’ as long as solution ‘Y’ is cheaper today. Tomorrow can look after itself, tomorrow is another budget year.

So not only is measurement not easy; perhaps we simply don’t care?

Perhaps the only option is just carry on doing what we think is as right as possible in the context that we work in?

 

Thinking Architecturally

If you start an architecture with a shopping list of technologies that must be used; that architecture will be compromised. However this does not mean that you start working without an appreciation of the possible, obviously you need to be aware of limitations such as constants such as the speed of light and other real constraints.

But currently I see a trend from many, both vendors and users, trying to fix round-hole problems with square-shaped blocks. Not enough time is spent on the problem definition and truly understanding the problem; your existing tools may not be sufficient and although it may feel that it is more expensive to implement something new, at times it might be cheaper in the long-term to implement something right.

Also be aware of falling into the trap of implementing a feature just because you’ve made the mistake of purchasing something that does not fit your problem definition. If you’ve been sold something that you can’t use effectively, you have a couple of option; suck it up and learn from experience or shout and holler at your vendor/partner for selling you something which is merely shelf-ware. In my experience, the latter is often ultimately pointless and simply results in the vendor promising you some other product which you put on a shelf and not use. Use the experience to move away from architecting to utilise a feature and architecting to solve a problem.

This does not mean that you simply purchase a new system/technology for every problem; governance has a role but I would suggest that governance should be applied after the initial high-level-architecture. I like to think of it like more more traditional bricks and mortar architecture; the architect relies on a whole bunch of technical people to fulfil their vision and bring it to reality. At times these technical people will tell the architect that the architect is a complete moron; sometimes the architect will agree and sometimes the architect will work with the technical teams to come up with something innovative and new.

But in general the architect does not start their design with a specific make of brick in mind. Neither should an IT architect.

Into the Pit

Well, it seems that mobile has really come of age and the standard sysadmin tool of SSH really doesn’t cut it any more; anyone who has suffered the frustration of a dropped connection in the middle of doing something or just shutting their laptop lid by mistake when docking is going to love MOSH.

MOSH is a replacement for SSH which supports roaming and intermittent connections; actually, you still need SSH to make the initial connection but when the connection is made, it is handed over to the mosh-server. There are many cool things about MOSH; firstly it doesn’t run as a daemon and in fact, you don’t even need to get your friendly admin to install it for you. You can happily run it from your own home directory; of course, I would suggest that you do get your friendly admin to install it for everyone and themselves!

For laggy connections, MOSH does not wait for the server to respond before displaying what you’ve typed; on a laggy connection, it’s a bit reminiscent of using the old mainframe terminals but much, much nicer. On an unreliable connection, MOSH will underline outstanding actions so that you should never get lost. This even works with VIM and other full-screen editors, this will be a bit of mind-f**k at first but you’ll soon get used to it.

It is still missing some SSH functionality but it appears to be coming on quickly.

MOSH is cool but there’s a catch; there’s no Windows client yet, I’m sure someone will get round to it. And there’s no mobile clients yet as far as I could tell; it is crying out for an Android and iOS client to become truly awesome.

But give it at go; I think that it’ll eventually become my default remote client…

MOSH can be found here