Mike Roberts

NOVEMBER 16, 2017

Scaling and State This is Part 9 of Learning Lambda, a tutorial series about engineering using AWS Lambda. So far in this series we’ve only been talking about processing a small number of events with Lambda, one after the other. Finally I mention Lambda’s limited, but not trivial, vertical scaling capability.

Lambda 52

Lambda Software Review AWS Serverless 52

Honeycomb

MARCH 5, 2024

In this post, I describe how to send OpenTelemetry (OTel) data from an AWS Lambda instance to Honeycomb. I will be showing these steps using a Lambda written in Python and created and deployed using AWS Serverless Application Model (AWS SAM). Add OTel and Honeycomb environment variables to your template configuration for your Lambda.

Lambda 52

Lambda AWS Data Serverless 52

Mike Roberts

NOVEMBER 14, 2017

Cold Starts This is Part 8 of Learning Lambda, a tutorial series about engineering using AWS Lambda. In this installment of Learning Lambda I discuss Cold Starts. In this installment of Learning Lambda I discuss Cold Starts. Way back in Part 3 I talked about the lifecycle of a Lambda function.

Lambda 52

Lambda Software Review AWS Systems Review 52

Xebia

MAY 2, 2023

In the coming paragraphs we will identify how we can write Infrastructure as Code (IaC) as well as the K8s workload definition for an application that will be deployed on AWS. Ini the following example, the definition of the S3 bucket can be considered declarative. InstanceType('t3.large')]

AWS 130

AWS Infrastructure Applications Construction 130

Xebia

JANUARY 19, 2023

The data engineer is also expected to create agile data architectures that evolve as new trends emerge. Building architectures that optimize performance and cost at a high level is no longer enough. Principles of a good Data Architecture Successful data engineering is built upon rock-solid architecture.

Data Engineering 130

Data Engineering Engineering Data Technical Review 130

Mike Roberts

DECEMBER 13, 2017

Lambda is a wonderful platform. The problems In Learning Lambda Part 9 , I described Lambda’s scaling behavior? Lambda can overwhelm downstream resources that do not have similar scaling properties. A thousand-times scaled Lambda could easily cause significant performance problems to a modest SQL database server.

Lambda 40

Lambda AWS Architecture Microservices 40

Mike Roberts

DECEMBER 13, 2017

Lambda is a wonderful platform. The problems In Learning Lambda Part 9 , I described Lambda’s scaling behavior? Lambda can overwhelm downstream resources that do not have similar scaling properties. A thousand-times scaled Lambda could easily cause significant performance problems to a modest SQL database server.

Lambda 40

Lambda AWS Architecture Microservices 40

Xebia

AUGUST 29, 2023

A target group can refer to Instances, IP addresses, a Lambda function or an Application Load Balancer. Participants were happy with the service abstraction cross EC2 / EKS / Lambda allowing inter-connectivity between different stacks without worrying about the underlying details. However, it does have consequences.

AWS 130

AWS Load Balancer Microservices Lambda 130

Mike Roberts

NOVEMBER 16, 2017

Scaling and State This is Part 9 of Learning Lambda, a tutorial series about engineering using AWS Lambda. So far in this series we’ve only been talking about processing a small number of events with Lambda, one after the other. Finally I mention Lambda’s limited, but not trivial, vertical scaling capability.

Lambda 40

Lambda Software Review AWS Serverless 40

Netlify

MARCH 10, 2020

VM => Lambda functions. If you’re looking to get a glimpse of the future of JAMstack, you should definitely check out RedwoodJS. I’ll paraphrase Sid Sijbrandij (CEO of GitLab): This feels like Rails for the JavaScript age. Moving from: REST => GraphQL. Sprockets => Babel/webpack. Caching => Static site.

Lambda 88

Lambda Serverless Open Source Architecture 88

AWS Machine Learning - AI

SEPTEMBER 20, 2024

If required, the agent invokes one of two Lambda functions to perform a web search: SerpAPI for up-to-date events or Tavily AI for web research-heavy questions. The Lambda function retrieves the API secrets securely from Secrets Manager, calls the appropriate search API, and processes the results.

Generative AI 105

Generative AI Lambda Applications AWS 105

CircleCI

JULY 22, 2022

Compute consistency: It is a best practice to keep the underlying compute for self-hosted runners consistent within resource classes — each machine should be identically configured with the same architecture and environment. The Lambda function created in a subsequent step will update these values to match your scaling requirements.

AWS 98

AWS Lambda Meeting Software Review 98

ParkMyCloud

JULY 29, 2020

There’s a lot of talk about multi-cloud architecture – and apparently, a lot of disagreement about whether there is actually any logical use case to use multiple public clouds. First question: are companies actually using a multi-cloud architecture? IDG did not provide a term definition for multi-cloud. Do you agree?

Architecture 57

Architecture Cloud AWS Lambda 57

AWS Machine Learning - AI

OCTOBER 14, 2024

The application architecture for building the example chat-based Generative AI Claims application with fine-grained access controls is shown in the following diagram. The application architecture flow is as follows: User accesses the Generative AI Claims web application (App).

Generative AI 93

Generative AI Applications Lambda Policies 93

RapidValue

OCTOBER 12, 2020

In an effort to avoid the pitfalls that come with monolithic applications, Microservices aim to break your architecture into loosely-coupled components (or, services) that are easier to update independently, improve, scale and manage. Key Features of Microservices Architecture. Microservices Architecture on AWS.

Microservices 53

Microservices AWS Architecture Applications 53

Stackery

MAY 22, 2019

Serverless architecture has coined some new terms and, more confusingly, re-used a few older terms with new meanings. An app is a term without an exact technical definition, it’s a general term that includes ‘web services’ and ‘things running inside private networks that only do things for your organization.’. Cloudside Development.

Serverless 74

Serverless Lambda AWS Resources 74

Stackery

JUNE 14, 2019

Ben Kehoe recently wrote a post about AWS API Gateway to Lambda integration: How you should?—?and use API Gateway proxy integration with Lambda. When these three features are put together, it can turn API Gateway into a passthrough, letting you use your favorite web framework in a single Lambda to do all your routing and processing.

Lambda 45

Lambda Serverless Software Review Systems Review 45

Mike Roberts

MAY 22, 2018

I started writing “ Serverless Architectures ” in May 2016. I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. I thought a few folks might be interested.

Serverless 40

Serverless Architecture Lambda Microservices 40

Mike Roberts

MAY 22, 2018

I started writing “ Serverless Architectures ” in May 2016. I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. I thought a few folks might be interested.

Serverless 40

Serverless Architecture Lambda Microservices 40

Stacks on Stacks

NOVEMBER 29, 2018

Lambda layers and runtime API are two new feature of AWS Lambda which open up fun possibilities for customizing the Lambda runtime and enable decreased duplication of code across Lambda functions. Layers is aimed at a common pain point teams hit as the number of Lambdas in their application grows.

Lambda 40

Lambda Serverless AWS Continuous Delivery 40

O'Reilly Media - Ideas

MAY 19, 2020

A strict definition of “cloud” must also include software-as-a-service (SaaS) and platform-as-a-service (PaaS) offerings of all kinds—including email (Google G Suite email; Microsoft Exchange Online), office productivity suites (Google Docs and Sheets; Microsoft Office 365), and similar offerings.

Cloud 144

Cloud Microservices Serverless Survey 144

Confluent

JULY 10, 2019

We can use our new DECODE() function and enjoy CASE-like functionality: ksql> select definition, decode(definition, 'Proxy authentication required','Bad', 'Page not found','Bad', 'Redirect','Good', 'Unknown') label. applicationName = 'wordcount-lambda-example'. // Default artifact naming. If no match, return 'defaultvalue'.

Lambda 89

Lambda Analytics Testing Groups 89

Stackery

OCTOBER 14, 2019

With AWS Lambda as one of the top technology keywords for this year’s event, there are many sessions to sift through – Here are some of my favorites. Building microservices with AWS Lambda SVS343-R. Scalable serverless architectures using event-driven design API304. Serverless architectural patterns and best practices ARC307-R.

Serverless 13

Serverless Lambda AWS Microservices 13

Bernd Rucker

APRIL 20, 2021

Camunda Cloud Architecture Blog Post Series?—?Part One of your first tasks would be to sketch the basic architecture of your solution, and this blog post will guide you through some important early questions such as how to connect the workflow engine Zeebe with your application or with remote systems?

Architecture 63

Architecture Engineering Cloud Programming 63

AWS Machine Learning - AI

AUGUST 26, 2024

Through this series of posts, we share our generative AI journey and use cases, detailing the architecture, AWS services used, lessons learned, and the impact of these solutions on our teams and customers. Role context – Start each prompt with a clear role definition. Clear restrictions – Specify important limitations upfront.

Generative AI 126

Generative AI AWS Artificial Inteligence Technical Review 126

Stackery

SEPTEMBER 12, 2019

Dale Salter shared how A Cloud Guru started used serverless architecture from its inception and went on to provide details about their particular architecture. It definitely gave me hope for all that is to come for the Serverless Ecosystem! This was really impressive to see.

Serverless 14

Serverless AWS Lambda Conference 14

Apiumhub

SEPTEMBER 10, 2023

In a serverless architecture, our cloud provider spins up new instances of a server whenever a request is received. Building Evolutionary Architectures. Introduction to Serverless with AWS Lambda in C#, NDC London 2023. Indeed, every request gets its own server. Let’s address this point now. Parsons, R., Minnick, B.

Serverless 100

Serverless .Net Architecture AWS 100

Netflix Tech

JULY 30, 2019

Adoption As of writing this blog, Conductor orchestrates 600+ workflow definitions owned by 50+ teams across Netflix. The task definition parameter rateLimitFrequencyInSeconds sets the duration window, while rateLimitPerFrequency defines the number of tasks that can be scheduled in a duration window. As such, Conductor 2.x

Lambda 76

Lambda Weak Development Team Systems Review Metrics 76

Hu's Place - HitachiVantara

APRIL 24, 2018

Serverless computing is provided by a cloud service provider like AWS Lambda. or Python), set a few simple configuration parameters, and upload everything (along with required dependencies) to Lambda. Lambda persists the container until the function has done its job, then disappears. Serverless computing is used with containers.

Serverless 56

Serverless Lambda Software Review AWS 56

AWS Machine Learning - AI

OCTOBER 24, 2024

The agent can recommend software and architecture design best practices using the AWS Well-Architected Framework for the overall system design. The agent can generate SQL queries using natural language questions using a database schema DDL (data definition language for SQL) and execute them against a database instance for the database tier.

Generative AI 96

Generative AI Artificial Inteligence Applications Knowledge Base 96

Stackery

OCTOBER 29, 2019

How the inventor of AWS Lambda built their latest stack 60x faster. Definitely. When Tim started to work on his supercomputer idea, he knew it involved coordinating a lot of Lambdas and performing WebSocket communication. Architecture is not a one-time or even an annual process. Sound nuts?

Serverless 10

Serverless Lambda Architecture Video 10

Erik Bernhardsson

SEPTEMBER 7, 2016

I generally haven’t written much about software architecture. This has been something just vaguely sitting in my head lacking a clear conceptual definition until a whole slew of things popped up today that all had the exact same issue at its core. People make heuristics into religion. But feel free to steal :).

Lambda 100

Lambda Firewall Open Source System 100

Erik Bernhardsson

SEPTEMBER 7, 2016

I generally haven’t written much about software architecture. This has been something just vaguely sitting in my head lacking a clear conceptual definition until a whole slew of things popped up today that all had the exact same issue at its core. People make heuristics into religion. But feel free to steal :).

Lambda 100

Lambda Firewall Open Source System 100

Stackery

JULY 1, 2020

Lambda Function ? In the above example, we are adding permission for a Lambda Function to create, read, update, and delete items inside the table. For example, a three-tier application can be constructed using an API Gateway HTTP API , some Lambda Functions, and a DynamoDB Table. For example, if a ? wants to interact with a ?DynamoDB

Serverless 72

Serverless AWS Authentication Lambda 72

Honeycomb

OCTOBER 31, 2022

There’s a whole class of things you just don’t have to think about if, say, your system is running on lambdas. They might work with product teams to understand how architecture choices impact COGS. PS: If you missed Charity’s post on platform engineering , it’s definitely worth a read. Vendors vs. internal platform teams.

DevOps 76

DevOps Lambda Engineering AWS 76

Honeycomb

MARCH 24, 2022

If you have a simpler architecture, does o11y matter?” — this question came up during recent office hours. On both counts—yeah, it sorta came out of microservices and cloud native, and yeah sorta, you need it with a simpler architecture (though perhaps not as desperately as you otherwise might). Yeah, sort of.

Microservices 59

Microservices Architecture Metrics PHP 59

Modus Create

MARCH 28, 2022

Today, we will discuss uploading files to AWS S3 using a serverless architecture. We will do so with the help of the following services from AWS — API Gateway , AWS Lambda , and AWS S3. . To do this, just add the following definitions on serverless.yml at the provider level. Lambda function. Configuring the Environment.

Serverless 40

Serverless AWS Lambda Resources 40