Cloudera

SEPTEMBER 9, 2022

The promise of a modern data lakehouse architecture. Imagine having self-service access to all business data, anywhere it may be, and being able to explore it all at once. Imagine quickly answering burning business questions nearly instantly, without waiting for data to be found, shared, and ingested.

Architecture 102

Architecture Innovation Data Open Source 102

CIO

NOVEMBER 7, 2024

Caldas has established herself as a decisive, growth-oriented executive and innovative strategist with an impressive track record of leading large complex transformations and executing with real solutions. By demystifying data and going beyond its abstract nature, we empower ourselves to harness it effectively.

Artificial Inteligence 180

Artificial Inteligence Development Generative AI Artificial Intelligence 180

Cloudera

DECEMBER 21, 2021

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. The post Cloudera Data Engineering 2021 Year End Review appeared first on Cloudera Blog.

Data Engineering 118

Data Engineering Technical Review Software Review Engineering 118

CIO

JANUARY 22, 2025

Toshibas Roberge is creating an innovation and strategy department for the IT organizations he heads. Were going to identify and hire data engineers and data scientists from within and beyond our organization and were going to get ahead, he says.

Weak Development Team 192

Weak Development Team Education Meeting Data 192

CIO

OCTOBER 13, 2023

The data architect also “provides a standard common business vocabulary, expresses strategic requirements, outlines high-level integrated designs to meet those requirements, and aligns with enterprise strategy and related business architecture,” according to DAMA International’s Data Management Body of Knowledge.

Data 199

Data Data Engineering Database Administration Artificial Inteligence 199

Cloudera

DECEMBER 2, 2024

Cloudera is committed to providing the most optimal architecture for data processing, advanced analytics, and AI while advancing our customers’ cloud journeys. Companies adopting AI now face a new obstacle to innovation: they must support AI development while meeting corporate goals for sustainability.

Sustainability 89

Sustainability AWS Analytics Infrastructure 89

AWS Machine Learning - AI

NOVEMBER 15, 2024

Some users lacked access to corporate data, but they used the platform as a generative AI chatbot to securely attach internal-use documentation (also called initial generic entitlement) and query it in real time or to ask questions of the model’s foundational knowledge without risk of data leaving the tenant.

Generative AI 113

Generative AI AWS Groups Artificial Inteligence 113

AWS Machine Learning - AI

MARCH 13, 2025

MaestroQA integrated Amazon Bedrock into their existing architecture using Amazon Elastic Container Service (Amazon ECS). The following architecture diagram demonstrates the request flow for AskAI. Conclusion Using AWS, MaestroQA was able to innovate faster and gain a competitive advantage. The best is yet to come.

Generative AI 113

Generative AI CTO Coach AWS Artificial Inteligence 113

CIO

AUGUST 3, 2022

The target architecture of the data economy is platform-based , cloud-enabled, uses APIs to connect to an external ecosystem, and breaks down monolithic applications into microservices. The challenge for CIOs who want to improve their company’s analytics capabilities is a familiar one: data integrity versus innovation. “In

Leadership 218

Leadership IoT SDLC Machine Learning 218

CTOvision

MAY 1, 2014

IO has pioneered the next-generation of data center infrastructure technology and Intelligent Control, which lowers the total cost of data center ownership for enterprises, governments, and service providers. We are looking for a talented Big Data Software Engineer to join the Applied Intelligence group in San Francisco.

Big Data 107

Big Data Data Engineering Engineering Data Center 107

Cloudera

DECEMBER 4, 2024

introduces new features specifically designed to fuel GenAI initiatives: New AI Processors: Harness the power of cutting-edge AI models with new processors that simplify integration and streamline data preparation for GenAI applications. Cloudera’s Vision: Universal Data Distribution With DataFlow 2.9,

Metrics 93

Metrics Generative AI Open Source Data Engineering 93

Cloudera

OCTOBER 23, 2024

In August, we wrote about how in a future where distributed data architectures are inevitable, unifying and managing operational and business metadata is critical to successfully maximizing the value of data, analytics, and AI.

Data 84

Data Analytics Systems Review Architecture 84

CIO

APRIL 12, 2023

After walking his executive team through the data hops, flows, integrations, and processing across different ingestion software, databases, and analytical platforms, they were shocked by the complexity of their current data architecture and technology stack. It isn’t easy.

Artificial Inteligence 218

Artificial Inteligence Artificial Intelligence Machine Learning Agile 218

AWS Machine Learning - AI

APRIL 23, 2025

Designed with a serverless, cost-optimized architecture, the platform provisions SageMaker endpoints dynamically, providing efficient resource utilization while maintaining scalability. The following diagram illustrates the solution architecture. Key architectural decisions drive both performance and cost optimization.

Artificial Inteligence 66

Artificial Inteligence Open Source AWS Serverless 66

O'Reilly Media - Ideas

FEBRUARY 18, 2020

This year’s growth in Python usage was buoyed by its increasing popularity among data scientists and machine learning (ML) and artificial intelligence (AI) engineers. Software architecture, infrastructure, and operations are each changing rapidly. Trends in software architecture, infrastructure, and operations.

Technical Review 145

Technical Review Microservices Data Engineering Architecture 145

Cloudera

APRIL 14, 2021

What is Cloudera Data Engineering (CDE) ? Cloudera Data Engineering is a serverless service for Cloudera Data Platform (CDP) that allows you to submit jobs to auto-scaling virtual clusters. Refer to the following cloudera blog to understand the full potential of Cloudera Data Engineering. .

Data Engineering 84

Data Engineering Engineering Data Serverless 84

CIO

JUNE 23, 2023

According to the MIT Technology Review Insights Survey, an enterprise data strategy supports vital business objectives including expanding sales, improving operational efficiency, and reducing time to market. The problem is today, just 13% of organizations excel at delivering on their data strategy.

Strategy 174

Strategy Technical Review Data Software Review 174

Perficient

FEBRUARY 13, 2025

Breaking down silos has been a drumbeat of data professionals since Hadoop, but this SAP <-> Databricks initiative may help to solve one of the more intractable data engineering problems out there. SAP has a large, critical data footprint in many large enterprises. However, SAP has an opaque data model.

Government 64

Government Open Source Machine Learning Artificial Inteligence 64

Capgemini

NOVEMBER 21, 2024

Snowflake and Capgemini powering data and AI at scale Capgemini October 13, 2020 Organizations slowed by legacy information architectures are modernizing their data and BI estates to achieve significant incremental value with relatively small capital investments. This evolution is also being driven by many industry factors.

Data 52

Data Government Innovation Architecture 52

CIO

NOVEMBER 29, 2022

By George Trujillo, Principal Data Strategist, DataStax Innovation is driven by the ease and agility of working with data. Increasing ROI for the business requires a strategic understanding of — and the ability to clearly identify — where and how organizations win with data. Data and cloud strategy must align.

Organization 167

Organization Technical Review Data Artificial Inteligence 167

O'Reilly Media - Data

APRIL 3, 2018

This year’s sessions on Data Engineering and Architecture showcases streaming and real-time applications, along with the data platforms used at several leading companies. Data platforms. Privacy and security. Time-series and Graphs sessions. Stream Processing and Real-time Applications sessions.

Machine Learning 239

Machine Learning Artificial Inteligence Company Case Study 239

AWS Machine Learning - AI

APRIL 1, 2025

With App Studio, technical professionals such as IT project managers, data engineers, enterprise architects, and solution architects can quickly develop applications tailored to their organizations needswithout requiring deep software development skills. Outside of work, Samit enjoys playing cricket, traveling, and biking.

AWS 101

AWS Software Review Technical Review Generative AI 101

Abhishek Tiwari

FEBRUARY 26, 2020

The evolution of your technology architecture should depend on the size, culture, and skill set of your engineering organization. There are no hard-and-fast rules to figure out interdependency between technology architecture and engineering organization but below is what I think can really work well for product startup.

Architecture 82

Architecture MVC Engineering Organization 82

Apiumhub

JANUARY 26, 2022

Data engineer roles have gained significant popularity in recent years. Number of studies show that the number of data engineering job listings has increased by 50% over the year. And data science provides us with methods to make use of this data. Who are data engineers?

Data Engineering 52

Data Engineering Engineering Data Machine Learning 52

Apiumhub

JUNE 22, 2021

We are super excited to participate in the biggest and the most influential Data, AI and Advanced Analytics event in the Nordics! Data Innovation Summit ! There our Gema Parreño – Data Science expert at Apiumhub gives a talk about Alignment of Language Agents for serious video games. Data Innovation Summit topics.

Innovation 84

Innovation Data Technical Review Artificial Inteligence 84

Perficient

APRIL 22, 2025

Data Summit 2025 is just around the corner, and were excited to connect, learn, and share ideas with fellow leaders in the data and AI space. As the pace of innovation accelerates, events like this offer a unique opportunity to engage with peers, discover groundbreaking solutions, and discuss the future of data-driven transformation.

Meeting 52

Meeting Data Serverless Data Engineering 52

CIO

NOVEMBER 7, 2023

“Practically every electronic system utilized within our health system contributes to the data warehouse, playing a pivotal role in our data management and analytics efforts and providing unique insights into the problems we need to address,” says David Higginson, executive vice president and chief innovation officer.

Data 213

Data Artificial Inteligence Architecture Analytics 213

Apiumhub

FEBRUARY 6, 2023

We are excited to announce that for the second year in a row , Apiumhub will support the Data Innovation Summit , which will take place on May 11th and 12th in Kistamässan, Stockholm. Event Stages As mentioned above, the Data Innovation Summit will feature nine different stages, each presented by one of the sponsors of the event.

Innovation 84

Innovation Data Machine Learning Artificial Inteligence 84

CIO

JUNE 28, 2023

The R&D laboratories produced large volumes of unstructured data, which were stored in various formats, making it difficult to access and trace. Belcorp’s answer was a new AI Innovation Labs platform, which has earned the company a CIO 100 Award in IT Excellence.

Technical Review 157

Technical Review Analytics Innovation Architecture 157

Netflix Tech

JUNE 1, 2021

Data Engineers of Netflix?—?Interview Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. What drew you to Netflix?

Data Engineering 52

Data Engineering Engineering Data Culture 52

Capgemini

MARCH 19, 2025

Capgemini’s Global Data Science Challenge (GDSC) has been answering this question for years and, in 2024, it took on its most significant mission yet revolutionizing education through smarter decision making. The need for innovation in education is undeniable. Interesting read?

Generative AI 72

Generative AI Education Artificial Inteligence Policies 72

Xebia

FEBRUARY 3, 2023

You start out really small, perhaps a Proof of Concept, a small app or data engineering pipeline. So it is a pytest plugin that helps you define (architectural) rules (archon means ruler, but it also sounds a bit like the arch in architecture ) for your application. We created it at one of our innovation days at Xebia.

How To 130

How To Architecture Data Engineering Applications 130

Trigent

JUNE 20, 2022

To do this, they are constantly looking to partner with experts who can guide them on what to do with that data. This is where data engineering services providers come into play. Data engineering consulting is an inclusive term that encompasses multiple processes and business functions.

Data Engineering 52

Data Engineering Engineering Data Strategy 52

CIO

JUNE 19, 2024

They may also ensure consistency in terms of processes, architecture, security, and technical governance. Our platform engineering teams, which support more than 200 applications, have innovated around automation,” says Bob Simms, former director of enterprise infrastructure delivery at the US Patent and Trademark Office (USPTO).

Weak Development Team 208

Weak Development Team Engineering UI/UX Software Development 208

Erik Bernhardsson

DECEMBER 15, 2020

I had my first job as a software engineer in 1999, and in the last two decades I've seen software engineering changing in ways that have made us orders of magnitude more productive. For instance: internet first created DVD-by-mail, but the real internet-native innovation was streaming video.). The great productivity inequality.

Software Engineering 325

Software Engineering Engineering Tools Software 325

CIO

AUGUST 2, 2023

So Thermo Fisher Scientific CIO Ryan Snyder and his colleagues have built a data layer cake based on a cascading series of discussions that allow IT and business partners to act as one team. Martha Heller: What are the business drivers behind the data architecture ecosystem you’re building at Thermo Fisher Scientific?

Data 147

Data Architecture Government Strategy 147

Mobilunity

AUGUST 3, 2021

The cloud offers excellent scalability, while graph databases offer the ability to display incredible amounts of data in a way that makes analytics efficient and effective. Who is Big Data Engineer? Big Data requires a unique engineering approach. Big Data Engineer vs Data Scientist.

Big Data 52

Big Data Data Engineering Engineering Data 52