Rob Watson, one of the best Environmental Minds, once famously said “We are either going to be losers or heroes – there’s no room for anyone for anything in between”. The context was more from a Green Revolution perspective, but its apt with your Legacy Data. Its a decision between keeping your legacy System of Record On Premise and get no insights out of it versus moving them into the Cloud and mix them with unstructured data for better insights (most importantly be a Hero too).
Data Movement has become so seamless and fast with the advent of various data connectors and its extremely critical organizations bring their core System of Record (Structured in nature) and mix with the Social media feeds, for better customer insights and be aware of their preferences.
1. Infosphere System Z Connector – One of the best tools available for System Z Resources (VSAM Db2, IMS) with efficiency and performance built in. It consumes minimal MIPS as it reads the binaries directly. This connector is very apt for large volumes of data.
2. Syncsort DMX-H – Is a Hadoop ETL solution which seamlessly shifts heavy workloads from Mainframe into the Hadoop eco-system.
3. z/OS Connect – This reads any of your System Z data source and exposes them as a REST based API. This connector uses WOLA (Websphere Optimized Local Adaptor) at its backend, for bi-directional communication, and is suitable for Mobile based interfaces.
4. Sqoop – Meant only for Relational Data sources as its more SQL based. The lack of support in providing “WITH UR” in the statements, creates Data Locking issues. Its not meant for large volumes of data.
5.Rocket mainframe data service – Available on IBM Bluemix, this provides an easy way to leverage System Z Data for cloud and mobile services. Developers can use MongoDB or SQL based connectivity to access System Z Data.
6. Big SQL and Spark
Enterprises should have a crystallized view on the target platform, volumes, performance aspects and end user architecture before closing in on the options above.
As they say in Texas, “If all you ever do is all you’ve ever done, then all you’ll ever get is all you ever got”. So why keep your data at bay, when it can be bought into Cloud and made more meaningful.
What are your experiences ?