Xebia

JANUARY 19, 2023

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

Data Engineering 130

Data Engineering Engineering Data Technical Review 130

CIO

MARCH 13, 2025

To thrive in todays business environment, companies must align their technological and cultural foundations with their ultimate goals. At Brown & Brown, we constantly focus on articulating the value of technology in terms of business outcomes. To us, its not just about using technology its about thinking like a tech company.

Company 183

Company Generative AI Insurance Education 183

CIO

MARCH 13, 2025

Hes seeing the need for professionals who can not only navigate the technology itself, but also manage increasing complexities around its surrounding architectures, data sets, infrastructure, applications, and overall security. The speed of the cyber technology revolution is very fast and attackers are always changing behaviors.

Part-Time VPE 142

Part-Time VPE Weak Development Team Fractional VPE Fractional CTO 142

CIO

DECEMBER 12, 2024

The survey points to a fundamental misunderstanding among many business leaders regarding the data work needed to deploy most AI tools, says John Armstrong, CTO of Worldly, a supply chain sustainability data insights platform. Gen AI uses huge amounts of energy compared to some other AI tools, he notes.

Data 201

Data Survey Artificial Inteligence Education 201

CIO

FEBRUARY 19, 2025

Registered investment advisors, for example, have to jump over a few hurdles when deploying new technologies. Gen AI is still in its early days and the company is concerned about safely integrating the technology. To get to ROI requires data from several systems, she adds. And then there are guardrail considerations.

Google Cloud 206

Google Cloud CTO Coach Survey Software Development 206

CIO

DECEMBER 4, 2024

Changing demographics, fast-evolving technologies, and the globalization of job opportunities make recruiting and holding onto skilled professionals much more difficult. As technology continues to change more rapidly than ever, CIOs who want to build and maintain a team with the right skills will need to do these four things.

Recruiting 202

Recruiting Artificial Inteligence Programming Technology 202

CIO

DECEMBER 20, 2024

On the other hand, DMBOK 2 defines data modeling as, the process of discovering, analyzing, representing, and communicating data requirements in a precise form called the data model. Data modeling takes a more focused view of specific systems or business cases. Data integrity. Scalable data pipelines.

Architecture 183

Architecture Data Fractional CTO Technical Review 183

CIO

NOVEMBER 27, 2024

Adopting Operational AI Organizations looking to adopt Operational AI must consider three core implementation pillars: people, process, and technology. The team should be structured similarly to traditional IT or data engineering teams.

Architecture 193

Architecture Artificial Inteligence Data Development Team Review 193

Xebia

FEBRUARY 28, 2025

Being ready means understanding why you need that technology and what it is. In 2019 alone the Data Scientist job postings on Indeed rose by 256% [2]. Universities have been pumping out Data Science grades in rapid pace and the Open Source community made ML technology easy to use and widely available.

Technical Review 182

Technical Review Weak Development Team Machine Learning Artificial Inteligence 182

Cloudera

DECEMBER 21, 2021

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. The post Cloudera Data Engineering 2021 Year End Review appeared first on Cloudera Blog.

Data Engineering 118

Data Engineering Technical Review Software Review Engineering 118

TechCrunch

NOVEMBER 18, 2021

There are three core roles involved in ML modeling, but each one has different motivations and incentives: Data engineers: Trained engineers excel at gleaning data from multiple sources, cleaning it and storing it in the right formats so that analysis can be performed.

Enterprise 344

Enterprise Artificial Inteligence Data Engineering Data Center 344

CIO

FEBRUARY 25, 2025

Being in IT has never been just about technology. For us, its about driving growth, innovation and engagement through data and technology while keeping our eyes firmly on the business outcomes. Being data-forward isnt just about technology. Mike Vaughan serves as Chief Data Officer for Brown & Brown Insurance.

Data 136

Data Innovation Insurance Culture 136

The Crazy Programmer

NOVEMBER 6, 2021

IT or Information technology is the industry that has registered continuous growth. The Indian information Technology has attained about $194B in 2021 and has a 7% share in GDP growth. Because startups like Zerodha, Ola, and Rupay to large organizations like Infosys, HCL Technologies Ltd, all will grow at a mass scale.

Artificial Inteligence 290

Artificial Inteligence Blockchain Software Review Artificial Intelligence 290

CIO

JANUARY 22, 2025

You expect a certain amount of shadow IT, but there was much more of it last year, says Krishna Prasad, CIO of technology services business at UST. The trouble is, when people in the business do their own thing, IT loses control, and protecting against loss of data and intellectual property becomes an even bigger concern.

Weak Development Team 192

Weak Development Team Education Meeting Data 192

CIO

DECEMBER 10, 2024

The sheer number of options and configurations, not to mention the costs associated with these underlying technologies, is multiplying so quickly that its creating some very real challenges for businesses that have been investing heavily to incorporate AI-powered capabilities into their workflows.

Artificial Inteligence 174

Artificial Inteligence Off-The-Shelf Insurance Analytics 174

CIO

NOVEMBER 19, 2024

The challenges of integrating data with AI workflows When I speak with our customers, the challenges they talk about involve integrating their data and their enterprise AI workflows. The core of their problem is applying AI technology to the data they already have, whether in the cloud, on their premises, or more likely both.

Artificial Inteligence 174

Artificial Inteligence Engineering Data Storage 174

CIO

DECEMBER 19, 2024

As the chief research officer at IDC, I lead a global team of analysts who develop research and provide advice to help our clients navigate the technology landscape. Fast forward to 2024, and our data shows that organizations have conducted an average of 37 proofs of concept, but only about five have moved into production.

Artificial Inteligence 146

Artificial Inteligence Research Artificial Intelligence Enterprise 146

Altexsoft

OCTOBER 30, 2021

If you’re an executive who has a hard time understanding the underlying processes of data science and get confused with terminology, keep reading. We will try to answer your questions and explain how two critical data jobs are different and where they overlap. Data science vs data engineering.

Data Engineering 98

Data Engineering Engineering Data Machine Learning 98

Netflix Tech

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 81

Data Engineering Engineering Data Generative AI 81

O'Reilly Media - Data

SEPTEMBER 24, 2018

Data science is the sexy thing companies want. The data engineering and operations teams don't get much love. The organizations don’t realize that data science stands on the shoulders of DataOps and data engineering giants. Let's call these operational teams that focus on big data: DataOps teams.

Enterprise 208

Enterprise Data Big Data Data Engineering 208

CIO

JANUARY 3, 2025

An increasingly complex technology landscape makes it more difficult to resolve issues. Today, IT encompasses site reliability engineering (SRE), platform engineering, DevOps, and automation teams, and the need to manage services across multi-cloud and hybrid-cloud environments in addition to legacy systems.

Organization 158

Organization Artificial Inteligence Artificial Intelligence DevOps 158

CIO

OCTOBER 13, 2023

Data architect role Data architects are senior visionaries who translate business requirements into technology requirements and define data standards and principles, often in support of data or digital transformations. Data architect vs. data engineer The data architect and data engineer roles are closely related.

Data 199

Data Database Administration Data Engineering Artificial Inteligence 199

Dzone - DevOps

DECEMBER 31, 2024

MLOps, or Machine Learning Operations, is a set of practices that combine machine learning (ML), data engineering, and DevOps to streamline and automate the end-to-end ML model lifecycle. MLOps is an essential aspect of the current data science workflows.

Machine Learning 96

Machine Learning Artificial Inteligence Scalability Data Engineering 96

O'Reilly Media - Ideas

JANUARY 25, 2024

While we like to talk about how fast technology moves, internet time, and all that, in reality the last major new idea in software architecture was microservices, which dates to roughly 2015. We’re skeptical about things like job displacement, at least in technology. This has been a strange year. What will those changes be?

Trends 134

Trends Technical Review Technology Artificial Inteligence 134

TechCrunch

OCTOBER 13, 2022

Data engineers have a big problem. Almost every team in their business needs access to analytics and other information that can be gleaned from their data warehouses, but only a few have technical backgrounds. ” Tracking venture capital data to pinpoint the next US startup hot spots.

Operating System 233

Operating System Technical Review Analytics Systems Review 233

Cloudera

DECEMBER 2, 2024

With each technology advancement, Cloudera moves closer to creating a sustainable analytics ecosystem. Today, Cloudera Data Engineering, a data service that streamlines and scales data pipeline development, is available with support for AWS Graviton processors. Cloudera Data Engineering is just the start.

Sustainability 89

Sustainability AWS Analytics Infrastructure 89

TechCrunch

OCTOBER 11, 2022

It certainly makes some bold claims, saying, “Quantori’s data engineering and data science platform for drug discovery and development aims to build a new data integration and high-performance computational environment for global and early-stage biopharma companies.

Development 248

Development Pharmaceuticals Data Engineering Engineering 248

O'Reilly Media - Ideas

MARCH 1, 2023

Our data shows us what O’Reilly’s 2.8 That’s a better measure of technology trends than anything that happens among the Twitterati. But other technology topics (including some favorites) are hitting plateaus or even declining. What’s real, and what isn’t? While we don’t discuss the economy as such, it’s always in the background.

Trends 144

Trends Technical Review Technology Software Review 144

TechCrunch

FEBRUARY 7, 2022

Prior to becoming CEO of Foursquare, Gary was MD of Raine, leading the technology practice with a focus on advisory assignments and principal investments in consumer internet, enterprise software and emerging technology. Contributor. Share on Twitter.

Business Intelligence 230

Business Intelligence AWS Data Engineering Sustainability 230

TechCrunch

JUNE 15, 2021

Art Zeile is the CEO of DHI Group , which operates Dice , the leading tech career marketplace connecting employers with skilled technology professionals. While all startups are certainly not focused on being disruptive, they often rely on cutting-edge technology and processes to give their customers something truly new.

Recruiting 233

Recruiting Data Engineering Report Groups 233

CIO

NOVEMBER 27, 2024

Not cleaning your data enough causes obvious problems, but context is key. “In A golden dataset of questions paired with a gold standard response can help you quickly benchmark new models as the technology improves. In the generative AI world, the notion of accuracy is much more nebulous.”

Data 211

Data Enterprise Weak Development Team Software Review 211

CIO

JUNE 7, 2022

But the success of their AI initiatives depends on more than just data and technology — it’s also about having the right people on board. An effective enterprise AI team is a diverse group that encompasses far more than a handful of data scientists and engineers. Data engineer.

Artificial Inteligence 218

Artificial Inteligence Technical Review Fractional CTO Data Engineering 218

TechCrunch

NOVEMBER 14, 2022

The complexity of streaming data technologies – not just streaming video but any kind of streaming data – has created a headache around dealing with that high speed data processing. Accordingly, companies like Spark, Flink have spring up to address this ksqlDB.

Data 208

Data B2B Machine Learning Artificial Inteligence 208

TechCrunch

JULY 12, 2022

But building data pipelines to generate these features is hard, requires significant data engineering manpower, and can add weeks or months to project delivery times,” Del Balso told TechCrunch in an email interview. Investors followed suit. Systems use features to make their predictions.

Artificial Inteligence 249

Artificial Inteligence Machine Learning Marketing Data Engineering 249

TechCrunch

DECEMBER 9, 2020

An alumni of Silicon Valley accelerator Y Combinator and backed by LocalGlobe , Dataform had set out to help data-rich companies draw insights from the data stored in their data warehouses. Mining data for insights and business intelligence typically requires a team of data engineers and analysts.

Google Cloud 242

Google Cloud Data Operating System Business Intelligence 242

CIO

JANUARY 12, 2024

Overwhelming majorities of executives around the world are planning to spend money on generative AI this year, but very few are truly ready for the technology, according to a survey released today by the Boston Consulting Group. It forces conversations like ‘what kind of data stores do we have,’ and ‘what can we really do with them?’”

Generative AI 198

Generative AI Survey Data Engineering Report 198

TechCrunch

MARCH 23, 2022

At that time, the scrappy data analytics company had scooped up $3.5 million in funding to develop its tool for what happens after you’ve collected a bunch of data, namely assembling and organizing it so the data can be analyzed. Data collection isn’t the problem: It’s what companies are doing with it.

Open Source 213

Open Source Data Engineering Strategic Planning Analytics 213