Erik Bernhardsson

DECEMBER 15, 2020

I had my first job as a software engineer in 1999, and in the last two decades I've seen software engineering changing in ways that have made us orders of magnitude more productive. Much like the classic No Silver Bullet paper on software productivity, none of these things in themselves were a dramatic improvement.

Software Engineering 325

Software Engineering Engineering Tools Software 325

The Crazy Programmer

SEPTEMBER 9, 2022

Both software engineers and computer scientists are concerned with computer programs and software improvement and various related fields. What is Software Engineering? Software is more than just program code. The final result of software engineering is an effective and reliable software program.

Software Engineering 223

Software Engineering Engineering Software Hardware 223

CIO

DECEMBER 12, 2024

Misunderstanding the power of AI The survey highlights a classic disconnect, adds Justice Erolin, CTO at BairesDev, a software outsourcing provider. The legacy problem Legacy systems that collect and store limited data are part of the problem, says Rupert Brown, CTO and founder of Evidology Systems, a compliance solutions provider.

Data 201

Data Survey Artificial Inteligence Education 201

CIO

MARCH 20, 2025

In just two weeks since the launch of Business Data Cloud, a pipeline of $650 million has been formed, Klein said. We decided to collaborate after seeing that over 1,000 customers have already contacted us about utilizing the two companies data platforms together. This is an unprecedented level of customer interest.

Data 162

Data Artificial Inteligence Data Center Cloud 162

Netflix Tech

DECEMBER 14, 2023

Engineers from across the company came together to share best practices on everything from Data Processing Patterns to Building Reliable Data Pipelines. The result was a series of talks which we are now sharing with the rest of the Data Engineering community! In this video, Sr.

Data Engineering 106

Data Engineering Engineering Data Software Engineering 106

TechCrunch

NOVEMBER 18, 2021

Ashish Kakran , principal at Thomvest Ventures , is a product manager/engineer turned investor who enjoys supporting founders with a balance of technical know-how, customer insights, empathy with challenges and market knowledge. In the early 2000s, most business-critical software was hosted on privately run data centers.

Enterprise 344

Enterprise Artificial Inteligence Data Engineering Data Center 344

CIO

FEBRUARY 19, 2025

According to experts and other survey findings, in addition to sales and marketing, other top use cases include productivity, software development, and customer service. Use case 2: software development PGIM also uses gen AI for code generation, specifically using Github Copilot.

Google Cloud 206

Google Cloud CTO Coach Survey Software Development 206

The Crazy Programmer

NOVEMBER 6, 2021

Software Architect. A software architect is a professional in the IT sector who works closely with a development task. They are responsible for designing, testing, and managing the software products of the systems. If you want to become a software architect, then you have to learn high-level designing skills.

Artificial Inteligence 290

Artificial Inteligence Blockchain Software Review Artificial Intelligence 290

CIO

APRIL 23, 2025

It addresses fundamental challenges in data quality, versioning and integration, facilitating the development and deployment of high-performance GenAI models. data lake for exploration, data warehouse for BI, separate ML platforms).

Insurance 164

Insurance Artificial Inteligence Data Architecture 164

CIO

MARCH 12, 2024

Generative AI is already having an impact on multiple areas of IT, most notably in software development. Still, gen AI for software development is in the nascent stages, so technology leaders and software teams can expect to encounter bumps in the road.

Software Development 197

Software Development Software Review Weak Development Team Software 197

CIO

DECEMBER 20, 2024

Data streaming is data flowing continuously from a source to a destination for processing and analysis in real-time or near real-time. A container orchestration system, such as open-source Kubernetes, is often used to automate software deployment, scaling, and management. Container orchestration. Real-time analytics.

Architecture 183

Architecture Data Fractional CTO Technical Review 183

Netflix Tech

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 82

Data Engineering Engineering Data Generative AI 82

Xebia

FEBRUARY 28, 2025

The development- and operations world differ in various aspects: Development ML teams are focused on innovation and speed Dev ML teams have roles like Data Scientists, Data Engineers, Business owners. Since 2007 DevOps has been a massively influential methodology in software development. If yes, go for it.

Technical Review 182

Technical Review Weak Development Team Artificial Inteligence Machine Learning 182

Daffodil Software

AUGUST 24, 2022

Artificial Intelligence (AI) and data engineering are closely interlinked. On one hand, making sense of unstructured data is the process known as data science or data engineering.

Data Engineering 98

Data Engineering Engineering Artificial Intelligence Artificial Inteligence 98

TechCrunch

MARCH 31, 2021

The first is that it can be difficult to differentiate machine learning roles from more traditional job profiles (such as data analysts, data engineers and data scientists) because there’s a heavy overlap between descriptions. Recruiting for ML comes with several challenges. Image Credits: Snehal Kundalkar.

Artificial Inteligence 363

Artificial Inteligence Machine Learning Part-Time VPE Recruiting 363

TechCrunch

OCTOBER 7, 2021

If your customers are data engineers, it probably won’t make sense to discuss front-end web technologies. The educational and inspirational content you use to attract developers will depend on who is the best fit for your product. If you provide a mobile SDK, the right developer is building iOS and Android apps.

Weak Development Team 231

Weak Development Team Software Development Marketing Technical Advisors 231

CIO

APRIL 2, 2025

In this context, collaboration between data engineers, software developers and technical experts is particularly important. AI consultants talk to software development and IT departments as well as to management, product management or employees from the relevant field. These include: Analytical and structured thinking.

Artificial Inteligence 120

Artificial Inteligence Technical Advisors Artificial Intelligence Automotive 120

Altexsoft

OCTOBER 30, 2021

If you’re an executive who has a hard time understanding the underlying processes of data science and get confused with terminology, keep reading. We will try to answer your questions and explain how two critical data jobs are different and where they overlap. Data science vs data engineering.

Data Engineering 98

Data Engineering Engineering Data Artificial Inteligence 98

O'Reilly Media - Data

SEPTEMBER 24, 2018

Data science is the sexy thing companies want. The data engineering and operations teams don't get much love. The organizations don’t realize that data science stands on the shoulders of DataOps and data engineering giants. Let's call these operational teams that focus on big data: DataOps teams.

Enterprise 239

Enterprise Data Big Data Data Engineering 239

CIO

DECEMBER 22, 2022

DataOps (data operations) is an agile, process-oriented methodology for developing and delivering analytics. It brings together DevOps teams with data engineers and data scientists to provide the tools, processes, and organizational structures to support the data-focused enterprise. What is DataOps?

Analytics 195

Analytics Data Engineering Artificial Inteligence Machine Learning 195

CIO

NOVEMBER 19, 2024

The challenges of integrating data with AI workflows When I speak with our customers, the challenges they talk about involve integrating their data and their enterprise AI workflows. The core of their problem is applying AI technology to the data they already have, whether in the cloud, on their premises, or more likely both.

Artificial Inteligence 174

Artificial Inteligence Engineering Data Storage 174

CIO

DECEMBER 4, 2024

And since the latest hot topic is gen AI, employees are told that as long as they don’t use proprietary information or customer code, they should explore new tools to help develop software. The new team needs data engineers and scientists, and will look outside the company to hire them.

Recruiting 202

Recruiting Artificial Inteligence Programming Technology 202

TechCrunch

OCTOBER 11, 2022

It certainly makes some bold claims, saying, “Quantori’s data engineering and data science platform for drug discovery and development aims to build a new data integration and high-performance computational environment for global and early-stage biopharma companies.

Development 248

Development Pharmaceuticals Data Engineering Engineering 248

Dzone - DevOps

OCTOBER 30, 2023

To tackle this challenge head-on, software-based architectures are emerging as powerful solutions. In this article, we explore the synergy between software-based architecture and the development of interoperability solutions for IoT to provide insights relevant to software developers and data engineers.

IoT 95

IoT Architecture Software Data Engineering 95

CIO

FEBRUARY 26, 2024

Software developers Software programmers regularly produce software code, the lingua franca of the digital world. Learning the proper coding prompts can help software developers use LLMs to create and debug software , as well as increase their skills working with natural language processing (NLP).

Generative AI 167

Generative AI Artificial Inteligence Company Data Engineering 167

TechCrunch

FEBRUARY 7, 2022

Prior to becoming CEO of Foursquare, Gary was MD of Raine, leading the technology practice with a focus on advisory assignments and principal investments in consumer internet, enterprise software and emerging technology.

Business Intelligence 230

Business Intelligence AWS Data Engineering Sustainability 230

CIO

AUGUST 3, 2022

In today’s data economy, in which software and analytics have emerged as the key drivers of business, CEOs must rethink the silos and hierarchies that fueled the businesses of the past. They can no longer have “technology people” who work independently from “data people” who work independently from “sales” people or from “finance.”

IoT 218

IoT SDLC Leadership Artificial Inteligence 218

TechCrunch

APRIL 25, 2022

“Feature stores sit at the intersection of data and machine learning,” Michael Del Balso, the CEO of Tecton.ai , a startup developing feature store software for businesses, told TechCrunch in an email. They serve as the interface between data and [AI] models.”

Artificial Inteligence 225

Artificial Inteligence Machine Learning Data Engineering Enterprise 225

CIO

OCTOBER 13, 2023

Solutions data architect: These individuals design and implement data solutions for specific business needs, including data warehouses, data marts, and data lakes. Application data architect: The application data architect designs and implements data models for specific software applications.

Data 199

Data Database Administration Data Engineering Artificial Inteligence 199

TechCrunch

JULY 12, 2022

But building data pipelines to generate these features is hard, requires significant data engineering manpower, and can add weeks or months to project delivery times,” Del Balso told TechCrunch in an email interview. Del Balso says it’ll be used to scale Tecton’s engineering and go-to-market teams. “We

Artificial Inteligence 249

Artificial Inteligence Machine Learning Marketing Data Engineering 249

Xebia

APRIL 9, 2025

For example, events such as Twitters rebranding to X, and PySparks rise in the data engineering realm over Spark have all contributed to this decline. The initial excitement that once propelled the language into the limelight during the mid-2010s has diminished over the last 15 years.

Systems Review 130

Systems Review Programming Technical Review Engineering 130

TechCrunch

JULY 25, 2022

The software enables HR teams to digitize employee records, automate administrative tasks like employee onboarding and time-off management, and integrate employee data from different systems. HR software firms Namely and Ultimate Software. Many were still using spreadsheets or basic payroll software.

Recruiting 224

Recruiting Technical Review Software Review Systems Review 224

TechCrunch

APRIL 13, 2021

The promise of Meroxa is that can use a single platform for their various data needs and won’t need a team of experts to build their infrastructure and then manage it. “Honestly, people come to us as a real-time FiveTran or real-time data warehouse sink. Image Credits: Meroxa.

Data 248

Data Software Engineering Open Source Engineering 248

CIO

AUGUST 4, 2022

Interestingly, many companies do just that, creating a disconnect between data science teams and IT/DevOps when it comes to AI development. Data scientists would really love to just build models and do real core data science. This gap is a significant reason why AI pilot projects fail. “AI

Artificial Intelligence 214

Artificial Intelligence Artificial Inteligence DevOps Data Engineering 214

TechCrunch

MARCH 21, 2023

According to a survey from Great Expectations, which creates open source tools for data testing, 77% of companies have data quality issues and 91% believe that it’s impacting their performance. “Its platform sits above the data stack, providing a 360-degree oversight of the data assets.”

Data 202

Data Data Engineering Training Engineering 202

Cloudera

FEBRUARY 15, 2023

This month’s #ClouderaLife Spotlight features software engineer Amogh Desai. It also happens that the cloud providers update their instance types and deprecate them all the time leading to installation failures, making the customers feel that the software is faulty when truly it is the hardware.

Software Engineering 84

Software Engineering Software Review Engineering Software 84

CIO

JANUARY 6, 2023

But 86% of technology managers also said that it’s challenging to find skilled professionals in software and applications development, technology process automation, and cloud architecture and operations. Of those surveyed, 56% said they planned to hire for new roles in the coming year and 39% said they planned to hire for vacated roles.

LAN 215

LAN Systems Administration How To Software Engineering 215