Xebia

JANUARY 19, 2023

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

Data Engineering 130

Data Engineering Engineering Data Technical Review 130

CIO

APRIL 1, 2025

Job titles like data engineer, machine learning engineer, and AI product manager have supplanted traditional software developers near the top of the heap as companies rush to adopt AI and cybersecurity professionals remain in high demand. Theres real hand-holding that needs to be done.

Marketing 152

Marketing Software Development Software Development 152

CIO

JUNE 23, 2023

According to the MIT Technology Review Insights Survey, an enterprise data strategy supports vital business objectives including expanding sales, improving operational efficiency, and reducing time to market. The problem is today, just 13% of organizations excel at delivering on their data strategy.

Strategy 174

Strategy Technical Review Data Software Review 174

CIO

DECEMBER 10, 2024

Choreographing data, AI, and enterprise workflows While vertical AI solves for the accuracy, speed, and cost-related challenges associated with large-scale GenAI implementation, it still does not solve for building an end-to-end workflow on its own. These models are then integrated into workflows along with human-in-the-loop guardrails.

Artificial Inteligence 174

Artificial Inteligence Off-The-Shelf Insurance Analytics 174

CIO

OCTOBER 13, 2023

The data architect also “provides a standard common business vocabulary, expresses strategic requirements, outlines high-level integrated designs to meet those requirements, and aligns with enterprise strategy and related business architecture,” according to DAMA International’s Data Management Body of Knowledge.

Data 199

Data Data Engineering Database Administration Artificial Inteligence 199

CIO

JANUARY 3, 2025

Today, IT encompasses site reliability engineering (SRE), platform engineering, DevOps, and automation teams, and the need to manage services across multi-cloud and hybrid-cloud environments in addition to legacy systems. Experience and deliberate cross-functional learning opportunities are needed for people to acquire these skills.

Organization 158

Organization Artificial Inteligence Artificial Intelligence DevOps 158

CIO

FEBRUARY 14, 2023

Organizations have balanced competing needs to make more efficient data-driven decisions and to build the technical infrastructure to support that goal. Many companies today struggle with legacy software applications and complex environments, which leads to difficulty in integrating new data elements or services.

Artificial Inteligence 174

Artificial Inteligence Strategy Data Machine Learning 174

Cloudera

DECEMBER 2, 2024

As organizations adopt a cloud-first infrastructure strategy, they must weigh a number of factors to determine whether or not a workload belongs in the cloud. Cloudera is committed to providing the most optimal architecture for data processing, advanced analytics, and AI while advancing our customers’ cloud journeys.

Sustainability 89

Sustainability AWS Analytics Infrastructure 89

CIO

NOVEMBER 7, 2024

It covers essential topics like artificial intelligence, our use of data models, our approach to technical debt, and the modernization of legacy systems. We explore the essence of data and the intricacies of data engineering. On the defensive front, we established a Responsible AI Steering Committee.

Artificial Inteligence 180

Artificial Inteligence Development Generative AI Artificial Intelligence 180

CIO

JANUARY 22, 2025

srcset="[link] 1600w, [link] 300w, [link] 768w, [link] 1024w, [link] 1536w, [link] 1240w, [link] 150w, [link] 854w, [link] 640w, [link] 444w" width="1240" height="698" sizes="(max-width: 1240px) 100vw, 1240px"> Krishna Prasad, chief strategy officer and CIO, UST UST While many PoCs ran in 2024, most were disappointing.

Weak Development Team 192

Weak Development Team Education Meeting Data 192

CIO

DECEMBER 22, 2022

DataOps (data operations) is an agile, process-oriented methodology for developing and delivering analytics. It brings together DevOps teams with data engineers and data scientists to provide the tools, processes, and organizational structures to support the data-focused enterprise. What is DataOps?

Analytics 195

Analytics Data Engineering Artificial Inteligence Machine Learning 195

Netflix Tech

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 82

Data Engineering Engineering Data Generative AI 82

Netflix Tech

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Some techniques we used were: 1.

Data Engineering 108

Data Engineering Engineering Data Systems Review 108

Perficient

MARCH 13, 2025

In this case, Liquid Clustering addresses the data management and query optimization aspects of cost control soi simply and elegantly that I’m happy to take my hands off the controls. This made intuitive sense to me as an early Spark developer, and I had deep knowledge of both architectures.

Data Engineering 64

Data Engineering Government Engineering Data 64

CIO

APRIL 12, 2023

After walking his executive team through the data hops, flows, integrations, and processing across different ingestion software, databases, and analytical platforms, they were shocked by the complexity of their current data architecture and technology stack. How is data, process, and model drift managed for reliability?

Artificial Inteligence 218

Artificial Inteligence Artificial Intelligence Machine Learning Agile 218

Xebia

MARCH 13, 2025

Please have a look at this blog post on machine learning serving architectures if you do not know the difference. Let’s say you are a Data Scientist working in a model development environment. You have complete access to all historical data. The sections below explain this in more detail. Yet, we still promote reuse.

Training 130

Training Artificial Inteligence Machine Learning Data 130

CIO

NOVEMBER 29, 2022

Increasing ROI for the business requires a strategic understanding of — and the ability to clearly identify — where and how organizations win with data. It’s the only way to drive a strategy to execute at a high level, with speed and scale, and spread that success to other parts of the organization. Data and cloud strategy must align.

Organization 167

Organization Technical Review Data Artificial Inteligence 167

Cloudera

AUGUST 20, 2021

How CDP Enables and Accelerates Data Product Ecosystems. A multi-purpose platform focused on diverse value propositions for data products. That audit mechanism enables Information Security teams to monitor changes from all user interactions with data assets stored in the cloud or the data center from a centralized user interface.

Strategy 98

Strategy Data Technical Review Weak Development Team 98

Perficient

FEBRUARY 13, 2025

Breaking down silos has been a drumbeat of data professionals since Hadoop, but this SAP <-> Databricks initiative may help to solve one of the more intractable data engineering problems out there. SAP has a large, critical data footprint in many large enterprises. However, SAP has an opaque data model.

Government 64

Government Open Source Machine Learning Artificial Inteligence 64

Trigent

JUNE 20, 2022

To do this, they are constantly looking to partner with experts who can guide them on what to do with that data. This is where data engineering services providers come into play. Data engineering consulting is an inclusive term that encompasses multiple processes and business functions.

Data Engineering 52

Data Engineering Engineering Data Strategy 52

CIO

AUGUST 2, 2023

A data and analytics capability cannot emerge from an IT or business strategy alone. With both technology and business organization deeply involved in the what, why, and how of data, companies need to create cross-functional data teams to get the most out of it. That strategy is doomed to fail. What are the layers?

Data 147

Data Architecture Government Strategy 147

CIO

APRIL 27, 2023

The demand for specialized skills has boosted salaries in cybersecurity, data, engineering, development, and program management. The CIO typically ranks the highest in an IT department, responsible for managing the organization’s IT strategy, resources, operations, and overall goals. increase from 2021.

Technical Review 174

Technical Review Software Review Systems Review Software Engineering 174

CIO

SEPTEMBER 19, 2024

The challenge is that these architectures are convoluted, requiring multiple models, advanced RAG [retrieval augmented generation] stacks, advanced data architectures, and specialized expertise.” Reinventing the wheel is indeed a bad idea when it comes to complex systems like agentic AI architectures,” he says.

CTO Coach 207

CTO Coach Artificial Inteligence Open Source Fractional CTO 207

CIO

MAY 30, 2024

The State of Generative AI in the Enterprise report from Deloitte found that 75% of organizations expect generative AI technology to impact talent strategies within the next two years, and 32% of organizations that reported “very high” levels of generative AI expertise are already on course to make those changes. Cost : $4,000

Generative AI 206

Generative AI Artificial Inteligence Programming Azure 206

TechCrunch

MAY 26, 2022

“Data lineage and observability are key capabilities that can solve these complex issues. “Data lineage and observability are becoming the core component of any modern data architecture. Statista predicts that the combined cybersecurity and observability market will be worth $28.26 billion by 2024.

Data 228

Data Weak Development Team Enterprise Analysis 228

Capgemini

NOVEMBER 21, 2024

Snowflake and Capgemini powering data and AI at scale Capgemini October 13, 2020 Organizations slowed by legacy information architectures are modernizing their data and BI estates to achieve significant incremental value with relatively small capital investments. This evolution is also being driven by many industry factors.

Data 52

Data Government Innovation Architecture 52

CIO

AUGUST 18, 2022

The result is an emerging paradigm shift in how enterprises surface insights, one that sees them leaning on a new category of technology architected to help organizations maximize the value of their data. Enter the data lakehouse. You can intuitively query the data from the data lake.

Data 210

Data Technical Advisors Technical Review Artificial Inteligence 210

Honeycomb

APRIL 23, 2025

Your bill increases in line with: Traffic volume Instrumentation density Instrumentation density is partly a function of architecture (a system with hundreds of microservices is going to generate a lot more spans than a monolith will) and partly a function of engineering intent. These are, after all, data problems.

Weak Development Team 106

Weak Development Team Metrics Storage Engineering 106

CIO

NOVEMBER 7, 2023

Lakehouse architecture supports data-driven decisions Printing and digital imaging company Lexmark “has been on a journey to become a data-driven company for the last five to seven years, given we realized that data is the new ‘gold,’” says Vishal Gupta, global CTO and CIO and senior vice president of connected technology at Lexmark.

Data 213

Data Artificial Inteligence Architecture Analytics 213

AWS Machine Learning - AI

APRIL 1, 2025

With App Studio, technical professionals such as IT project managers, data engineers, enterprise architects, and solution architects can quickly develop applications tailored to their organizations needswithout requiring deep software development skills. Outside of work, Hao enjoys international traveling, exercising, and streaming.

AWS 92

AWS Software Review Technical Review Generative AI 92

CIO

AUGUST 7, 2023

While the changes to the tech stack are minimal when simply accessing gen AI services, CIOs will need to be ready to manage substantial adjustments to the tech architecture and to upgrade data architecture. Shapers want to develop proprietary capabilities and have higher security or compliance needs.

Generative AI 147

Generative AI Off-The-Shelf Architecture Infrastructure 147

CIO

SEPTEMBER 2, 2022

In the finance industry, software engineers are often tasked with assisting in the technical front-end strategy, writing code, contributing to open-source projects, and helping the company deliver customer-facing services. Director of software engineering. Data engineer.

Software Engineering 148

Software Engineering Data Engineering DevOps AWS 148

CIO

AUGUST 31, 2022

In the finance industry, software engineers are often tasked with assisting in the technical front-end strategy, writing code, contributing to open-source projects, and helping the company deliver customer-facing services. Director of software engineering. Data engineer.

Software Engineering 148

Software Engineering Data Engineering DevOps AWS 148

CIO

JULY 29, 2022

That focus includes not only the firm’s customer-facing strategies but also its commitment to investing in the development of its employees, a strategy that is paying off, as evidenced by Capital Group’s No. The bootcamp broadened my understanding of key concepts in data engineering.

Groups 147

Groups Security Development Programming 147

Cloudera

OCTOBER 1, 2022

As countries introduce privacy laws, similar to the European Union’s General Data Protection Regulation (GDPR), the way organizations obtain, store, and use data will be under increasing legal scrutiny. If that data carries specific attributes, it can’t leave the country. Deliver use cases to market.

Government 75

Government Enterprise Artificial Inteligence Strategy 75

CIO

NOVEMBER 9, 2022

Here are some tips for IT leaders looking to make good on the promise of self-service analytics strategies. Have a clear, comprehensive analytics plan Data analytics and analytics tools have gained such a high profile within many businesses that it’s easy to see how they can be overused or inappropriately applied.

Analytics 205

Analytics Metrics Government Business Intelligence 205

Perficient

APRIL 7, 2025

Our Finops strategy shifts left on performance. How Metadata Contention Can Slow Down User Queries When data ingestion and transformation pipelines rely on structural metadata changes, they introduce several stress points across Unity Catalogs architecture. If not, consider temporary views or tables.

Performance 52

Performance Software Review Systems Review Exercises 52