Remove Data Engineering Remove Engineering Remove Software Review
article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

Binning MapType, Keeping Yield. How Variant Delivered 10x Speed for Semiconductor Test Logs in Databricks

Xebia

“The fine art of data engineering lies in maintaining the balance between data availability and system performance.” The Data Platform: Databricks Melexis manages its testlogs data on Databricks, a cloud based data platform that lets you run data pipelines and machine learning models at scale.

Testing 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Are you ready for MLOps? 🫵

Xebia

These days Data Science is not anymore a new domain by any means. The time when Hardvard Business Review posted the Data Scientist to be the “Sexiest Job of the 21st Century” is more than a decade ago [1]. In 2019 alone the Data Scientist job postings on Indeed rose by 256% [2]. Why is that?

article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. That’s why we saw an opportunity to provide a no-code to low-code authoring experience for Airflow pipelines.

article thumbnail

No-code business intelligence service y42 raises $2.9M seed round

TechCrunch

. “We’re taking the best of breed open-source software. What we really want to accomplish is to create a tool that is so easy to understand and that enables everyone to work with their data effectively,” Y42 founder and CEO Hung Dang told me.

article thumbnail

Top 10 Highest Paying IT Jobs in India

The Crazy Programmer

Software Architect. A software architect is a professional in the IT sector who works closely with a development task. They are responsible for designing, testing, and managing the software products of the systems. If you want to become a software architect, then you have to learn high-level designing skills.

article thumbnail

The early returns on gen AI for software development

CIO

Generative AI is already having an impact on multiple areas of IT, most notably in software development. Early use cases include code generation and documentation, test case generation and test automation, as well as code optimization and refactoring, among others.