Bringing Valuable Information to DevOps Professionals

DevOps Journal

Subscribe to DevOps Journal: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get DevOps Journal: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


DevOpsJournal Authors: Liz McMillan, Yeshim Deniz, Zakia Bouachraoui, Pat Romanski, Elizabeth White

Related Topics: Cloud Data Analytics, Big Data on Ulitzer, DevOps Journal

Article

Bringing #DevOps to #DataScience | @DevOpsSummit @CAinc #AI #Analytics

DevOps can transform fractured data science into a repeatable business art form

Bringing DevOps to Analytics and Data Science

There's no shortage of material about DevOps on the Interwebs. But as you sift through mountains of information, it appears mostly skewed toward better and faster web and mobile app development. Look for details on how the thinking can be applied to the wicked world of data science or analytics and you'll be hard pressed to find much at all.

This seems odd, because a sustainable business isn't just carved out on the back of web and mobile apps. It's also dependent on intimately understanding customer data and pivoting towards the opportunities revealed - with yes, web and mobile apps.

It's not rocket science; it's data science, and web-scale companies understand it's fundamental for mega efficient business operations. It explains why Netflix has gone from stuffing DVDs through the mailbox to streaming their own shows, and how Amazon continues to redefine retail.

For most businesses the reality is quite different. Even though many consider themselves data-centric, they often struggle to get value from their data science initiatives. In part this might be explained by the ad-hoc nature of efforts, with new models only developed to support one-off projects. It might also be due to the massive amounts of effort needed to maintain and update these types of systems if they ever get deployed into the wild.

Blaming the tech, data or propeller heads is wrong. Today many businesses have mountains of data along with the scientists skilled in doing the math and building the analytical models.

They can even back this up with coding skills and have Big Data engineering teams laying down Kafka, Apache Spark and Hadoop-like technologies to deliver the number crunching grunt.

Yet problems still persist, with many businesses questioning the value of fragile analytics systems that need to be rebuilt every time a model changes. Worse still, any analysis that gets performed might deliver inconsistent results. If this leads to bad decision making, then data science can quickly become the organizational equivalent of snake oil.

The real reason behind these problems isn't tech or teams, it's the isolation of the data science and analytics function from IT development and engineering. Working alone, data science teams can find the right signal in all the data (even codify it), but lacking consistent access to production-like systems and test data means any results only get verified when a product goes live. When this eventually happens, these teams aren't set up to maintain or support them and can encounter stiff resistance from IT operations when systems are shown to be unreliable and fragile.

Faced with IT push-back, business units can of course be tempted to go it alone. This might be fine for a small one-off analytics project, but the cost and risk is prohibitive for the business as a whole if the result is application and code base disparity, overlapping or polluted datasets and complex infrastructure sprawl.

Worse than all the technology is the lost business opportunity. For fast and accurate decision making, businesses need teams, processes and technologies to become capable of supporting the continuous development, delivery, testing and refinement of analytical models that benefit the entire organization.

Of course this is all familiar to proponents of DevOps, where disparate application development teams and IT operations collaborate toward accelerating high-quality software services through a single high-speed process pipeline. Indeed, and as research such as Coleman Parkes' Accelerating Velocity and Customer Value with Agile and DevOps illustrates, advanced adopters use it to consistently outperform their competition.

This same kind of agility will be essential if data science and analytics is not only to become a viable function, but a powerful accelerant of digital value. To achieve this, companies should stop treating analytics as a piecemeal science experiment and start using it as a fully integrated business discipline. To this end, DevOps cross-functional processes and software can help, enabling data scientists, product teams, software development and IT operations to collaborate toward ensuring analytics fully deliver. One immediate beneficiary could be software engineering itself, where integrated customer-experience analytics and predictive modeling can provide valuable business insights into code effectiveness.

Data scientists will also benefit greatly from DevOps. By using automated test frameworks, test data management and service virtualization, analysts can prove or disprove their hypotheses well before production. Just as software developers can use these technologies to catch and remove code defects early, data scientists can use them to catch faulty models before they do any irreparable damage. They can also take advantage of proven agile development practices to release analytics software code and services in shorter cycles.

Benefits accrue when systems move to production. Here the domain knowledge, automation and scalable monitoring IT operations teams already provide can be leveraged. This includes automated release processing to rapidly deploy and split-test different versions of models into production, with monitoring services capturing functional and operability information and feeding it back into the development process.

These types of services are vital, because while a data science team might have many ‘eureka moments,' it's the automation that'll progress them beyond academic meanderings into a powerful and sustainable force for the business.

Ultimately, the success of a business will depend on how quickly and reliably business gains analytical insights from data. This won't happen in the lab, but when data science as a practice becomes industrialized and embraced by the entire organization.

By providing organizations a powerful framework upon which to build, test, deploy and monitor analytics as one continuous stream of value, DevOps can transform fractured data science into a repeatable business art form.


DXWorldEXPO LLC, the producer of the world's most influential technology conferences and trade shows has announced the conference tracks for CloudEXPO | DXWorldEXPO 2018 New York.

DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City.

Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.

A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throughout enterprises of all sizes.

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

Sponsorship Opportunities Here

Speaking Opportunities Here

Sponsorship and Speaking Inquiries: [email protected].

2018 Conference Agenda, Keynotes and 10 Conference Tracks

DXWordEXPO New York 2018 and Cloud Expo New York 2018 agenda present 222 rockstar faculty members, 200 sessions and 22 keynotes and general sessions in 10 distinct conference tracks.

  • Cloud-Native | Serverless
  • DevOpsSummit
  • FinTechEXPO - New York Blockchain Event
  • CloudEXPO - Enterprise Cloud
  • DXWorldEXPO - Digital Transformation (DX)
  • Smart Cities | IoT | IIoT
  • AI | Machine Learning | Cognitive Computing
  • BigData | Analytics
  • The API Enterprise | Mobility | Security
  • Hot Topics | FinTech | WebRTC

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

DXWorldEXPO | CloudEXPO 2018 New York cover all of these tools, with the most comprehensive program and with 222 rockstar speakers throughout our industry presenting 22 Keynotes and General Sessions, 200 Breakout Sessions along 10 Tracks, as well as our signature Power Panels. Our Expo Floor brings together the world's leading companies throughout the world of Cloud Computing, DevOps, FinTech, Digital Transformation, and all they entail.

As your enterprise creates a vision and strategy that enables you to create your own unique, long-term success, learning about all the technologies involved is essential. Companies today not only form multi-cloud and hybrid cloud architectures, but create them with built-in cognitive capabilities.

Cloud-Native thinking is now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector.

CloudEXPO is the world's most influential technology event where Cloud Computing was coined over a decade ago and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals.

FinTech Is Now Part of the DXWorldEXPO | CloudEXPO Program!

Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expensive intermediate processes from their businesses.

Accordingly, attendees at the upcoming 22nd CloudEXPO | DXWorldEXPO November 11-13, 2018 in New York City will find fresh new content in two new tracks called:

  • FinTechEXPO
  • New York Blockchain Event

which will incorporate FinTech and Blockchain, as well as machine learning, artificial intelligence and deep learning in these two distinct tracks.

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

Sponsorship Opportunities Here

Speaking Opportunities Here

Sponsorship and Speaking Inquiries: [email protected].

FinTech brings efficiency as well as the ability to deliver new services and a much improved customer experience throughout the global financial services industry. FinTech is a natural fit with cloud computing, as new services are quickly developed, deployed, and scaled on public, private, and hybrid clouds.

More than US$20 billion in venture capital is being invested in FinTech this year. DXWorldEXPOCloudEXPO are pleased to bring you the latest FinTech developments as an integral part of our program.

DXWorldEXPO | CloudEXPO are accepting speaking submissions for this new track, so please visit Cloud Computing Expo for the latest information or contact us at [email protected]

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

Sponsorship Opportunities Here

Speaking Opportunities Here

Sponsorship and Speaking Inquiries: [email protected].

Download Slide Deck ▸ Here

Only DXWorldEXPO | CloudEXPO bring together all this in a single location:

Attend DXWorldEXPO | CloudEXPO. Build your own custom experience. Learn about the world's latest technologies and chart your course to Digital Transformation.

22nd International DXWorldEXPO | CloudEXPO, taking place November 11-13, 2018, in New York City, will feature technical sessions from a rock star conference faculty and the leading industry players in the world.

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

Sponsorship Opportunities Here

Speaking Opportunities Here

Sponsorship and Speaking Inquiries: [email protected].

Download Slide Deck: ▸ Here

Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS - software, platform, and infrastructure as a service.

With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.

Every Global 2000 enterprise in the world is now integrating cloud computing in some form into its IT development and operations. Midsize and small businesses are also migrating to the cloud in increasing numbers.

Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)

Sponsorship Opportunities Here

Speaking Opportunities Here

Sponsorship and Speaking Inquiries: [email protected].

Download Slide Deck: ▸ Here

Companies are each developing their unique mix of cloud technologies and services, forming multi-cloud and hybrid cloud architectures and deployments across all major industries. Cloud-driven thinking has become the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, and the public sector.

Sponsorship Opportunities

DXWorldEXPO | CloudEXPO are the single show where technology buyers and vendors can meet to experience and discus cloud computing and all that it entails. Sponsors of DXWorldEXPO | CloudEXPO will benefit from unmatched branding, profile building and lead generation opportunities through:

  • Featured on-site presentation and ongoing on-demand webcast exposure to a captive audience of industry decision-makers.
  • Showcase exhibition during our new extended dedicated expo hours
  • Breakout Session Priority scheduling for Sponsors that have been guaranteed a 35-minute technical session
  • Online advertising on 4,5 million article pages in SYS-CON's i-Technology Publications
  • Capitalize on our Comprehensive Marketing efforts leading up to the show with print mailings, e-newsletters and extensive online media coverage.
  • Unprecedented PR Coverage: Unmatched editorial coverage on Cloud Computing Journal.
  • Tweetup to over 100,000 plus Twitter followers
  • Press releases sent on major wire services to over 500 industry analysts.

Secrets of Our Most Popular Sponsors and Exhibitors ▸ Here

For more information on sponsorship, exhibit, and keynote opportunities, contact [email protected].

Sponsorship Opportunities Here

Download Slide Deck:Here

Speaking Opportunities

The upcoming 22nd International DXWorldEXPO | CloudEXPO November 11-13, 2018 in New York City, NY announces that its Call For Papers for speaking opportunities is now open.

Secrets of Our Most Popular Faculty Members ▸ Here

Submit your speaking proposal Here or by email [email protected].

Download Slide Deck: ▸ Here

About DXWorldEXPO LLC

DXWorldEXPO LLC is a Lighthouse Point, Florida-based trade show company and the creator of DXWorldEXPODigital Transformation Conference & Expo. The company produces and presents CloudEXPO, DevOpsSummitFinTechEXPO Blockchain Event, the world's most influential conferences and trade shows.

More Stories By Pete Waterhouse

Pete Waterhouse, Senior Strategist at CA Technologies, is a business technologist with 20+ years’ experience in development, strategy, marketing and executive management. He is a recognized thought leader, speaker and blogger – covering key trends such as DevOps, Mobility, Cloud and the Internet of Things.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.