MettleCI

With the Information Server or DataStage (IIS/DS) Cartridge for Cloud Pak for Data, IBM includes entitlement to the MettleCI tool from our Data Migrators friends in Australia! What is MettleCI? Automation for development and migrations!

  • DevOps for DataStage
    • Automated Peer Review (Compliance)
    • Automated Unit Testing (generation & management)
    • Universal Git integration (Jobs and Unit Tests)
    • Continuous Integration / Continuous Delivery (CI/CD)
  • Automated Migration Support
    • Automated Static Code Analysis
    • Automatic job conversion
    • Manual job conversion

MettleCI benefits…

  • Automated/Semi-automated job migration
  • Expedited version-to-version migration
  • Lower cost of maintenance
  • Shorter time to delivery
  • Higher performance Jobs
  • Earlier, cheaper defect discovery
  • Lower testing costs
  • More reliable E2E execution
  • Zero-effort work item traceability / auditability
  • Release management with minimal effort
  • Visibly more productive DataStage teams
  • Demonstrable alignment with organization strategy

InfoServer on Cloud

Related to DataStage on Cloud, IBM now offers a fully-functioning Information Server environment environment on a hosted service on SoftLayer.  The announcement:

https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?infotype=an&subtype=ca&appname=gpateam&supplier=897&letternum=ENUS216-240

It has the same use cases as DataStage on Cloud…

  • Migrating to a new version.  No need to purchase monthly licenses, secure hardware and spin up an instance to test.  Simply “rent” a cloud instance to test code in a quickly-provisioned ready-to-use environment of the latest release.
  • Hybrid and Cloud data integration.  For companies utilizing On-Premises and Cloud, Cloud-to-Cloud, and/or Transitioning to Cloud.
  • Ad-hoc Dev, Test and Production requirements.  For new projects; once the development is complete, jobs are migrated back to On-Premises.

How do you do it?  Go to Bluemix, ‘swipe’ a credit card, and you’re on your way!

https://console.bluemix.net/catalog/services/information-server-on-cloud

Do you have to use Bluemix / SoftLayer in order to use InfoServer or DataStage on the Cloud?  No, we have customers that install it on other Cloud providers.  But in those instances, it is a “Bring Your Own License” and install the software yourself.

DataStage on Cloud

It’s here!  The announcement was made on May 10, 2016.  It is a fully-functional DataStage environment on a hosted service on SoftLayer.

(EDIT: about 4 months later, the offering is now called Information Server on Cloud, and when you go to the page on Bluemix to deploy the service, you can choose an InfoServer Enterprise Edition service, or just the DataStage service).

Announcement:

http://ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=897&letternum=ENUS216-192

Why would you need this?  There are many more reasons that this list, but here are my favorites:

  • Migrating to a new version.  No need to purchase monthly licenses, secure hardware and spin up an instance to test.  Simply “rent” a cloud instance to test code in a quickly-provisioned ready-to-use environment of the latest release.
  • Hybrid and Cloud data integration.  For companies utilizing On-Premises and Cloud, Cloud-to-Cloud, and/or Transitioning to Cloud.
  • Ad-hoc Dev, Test and Production requirements.  For new projects; once the development is complete, jobs are migrated back to On-Premises.

See the announcement for details, then consider how cool it would be to no longer worry about purchasing hardware!

Stewardship Center video

Several new capabilities were added to v11.3.1 which enable advanced workflow for Data Quality remediation and maintenance of Information Governance Assets.

IBM Stewardship Center provides a single collaborative environment for business users to define and monitor compliance with information governance policies and to manage data quality issues to resolution.

IBM Stewardship Center includes the following key capabilities that address the needs of users across the governance organization:

  • Workflows and rules to support data governance and quality activities.
  • Dashboards to monitor activity and progress.
  • Integrated social collaboration tools.
  • A browser-based, customizable interface.
  • The Stewardship Center Application Toolkit, which you can use to design custom business process management workflows for managing and resolving data quality issues in your organization.

For data remediation:

  • Provides details of exceptions captured during data integration, data cleansing and data profiling activities.
  • Drill into rule details in IGC to understand how this exception set relates to business objectives.
  • Edit values that were incorrect or use the Export / Import buttons to download / upload a CSV file with the records and associated fixes.
  • Prebuilt workflow includes review and approval steps for multiple organizational roles (Data Steward, Data Steward Manager, Data Source Owner)
  • Prebuilt workflow can be extended/customized to allow approved edits to be submitted to any REST service for automated cleanup.

You can enable IBM Stewardship Center to send email notification to specific recipients when an asset is created or changed, or the workflow for an asset is changed. When an information governance rule is sent for approval, the email contains a link to approve or reject the modified rule.

Video: https://youtu.be/CPnF-4BaA4Q