Swami Sivasubramanian Keynote Play-by-play

here we go...

@SwamiSivasubram with a data/ml 🧠 focused keynote at @awscloud #reinvent 2022!

/cc @AWSEvents

/🧵

@marknca tweeted at 30-Nov-2022, 16:30

very, very dramatic opening to this keynote

#reinvent

@marknca tweeted at 30-Nov-2022, 16:32

if @SwamiSivasubram gets lowered from the ceiling, I’m going to lose it...

#reinvent

@marknca tweeted at 30-Nov-2022, 16:33

apparently the team at @awsevents has realized they own @mgmstudios. crazy dramatic and intriguing intro!

#reinvent

@marknca tweeted at 30-Nov-2022, 16:33

@SwamiSivasubram up now. starting with a great prompt from his daughter, “How do scientists come up with these inventions?”

#reinvent

@marknca tweeted at 30-Nov-2022, 16:34

@SwamiSivasubram covering some key historical discoveries

#reinvent

@marknca tweeted at 30-Nov-2022, 16:35

“Are these ‘ah ha!’ moments really that fast? No. They assimilate information gathered over time”, @SwamiSivasubram

Swami walks through the actual timeline for the microwave discovery (30 years)

#reinvent

@marknca tweeted at 30-Nov-2022, 16:36

@SwamiSivasubram diving into how our brains work. how they combine disparate facts and experiences to draw new conclusions in different contexts

#reinvent

@marknca tweeted at 30-Nov-2022, 16:38

pivoting now to the lack of parallel with our organizations. they don’t store and process data like our 🧠

#reinvent

@marknca tweeted at 30-Nov-2022, 16:38

this is s great way to set up the central—or what I assume will be the central—theme of the keynote today

key issues:

• data isn’t centralized
• …isn’t automatically process
• …doesn’t naturally flow
• …isn’t easy to visualize

#reinvent

@marknca tweeted at 30-Nov-2022, 16:40

...

#reinvent

@marknca tweeted at 30-Nov-2022, 16:40

if you don’t solve 👆 👆, you aren’t going to see the benefits of all that data you create/ingest

#reinvent

@marknca tweeted at 30-Nov-2022, 16:41

nice summary slide of @awscloud / @amazon successes rooted in data analysis and insights

#reinvent

@marknca tweeted at 30-Nov-2022, 16:41

I think a lot of ppl sleep on @SwamiSivasubram’s keynote each year

there’s a tendency to think, “I don’t do data/ml that much”, that’s a mistake

this section is a great proof point that data insights drive EVERYTHING

#reinvent

@marknca tweeted at 30-Nov-2022, 16:43

good customer reference highlights

#reinvent

@marknca tweeted at 30-Nov-2022, 16:43

three core elements of a strong data strategy:

• future-proof foundation
• weave connective tissue
• democratize data with tools & education

#reinvent

@marknca tweeted at 30-Nov-2022, 16:44

@SwamiSivasubram is starting with “building a future-proof” data foundation

#reinvent

@marknca tweeted at 30-Nov-2022, 16:45

4 key elements to that foundation:

• tools for every workload
• performance at scale
• remove heavy lifting
• flexibility and scalability

#reinvent

@marknca tweeted at 30-Nov-2022, 16:45

“We believe that every customer should have access to a wide variety of tools…a one-size fits all approach simply doesn’t work in the long run”, @SwamiSivasubram

#reinvent

@marknca tweeted at 30-Nov-2022, 16:46

the updated datastore & analytics overview slides

#reinvent

@marknca tweeted at 30-Nov-2022, 16:47

the ml 🧠 layer cake makes a reappearnace

• remember, stay at the top for as long as possible. tread into the dungeon layer at your own peril!

#reinvent

@marknca tweeted at 30-Nov-2022, 16:48

the whole #!

#reinvent

@marknca tweeted at 30-Nov-2022, 16:48

nerds get the joke 👆

😉🤣🤦

(sorry, had to)

#reinvent

@marknca tweeted at 30-Nov-2022, 16:49

back to @SwamiSivasubram giving a nice shout out to Athena. I ❤️ because everything just stays in S3…very efficient and cost effective

#reinvent

@marknca tweeted at 30-Nov-2022, 16:49

more on @awscloud Athena at https://aws.amazon.com/athena/

take some time to check it out if you haven’t already

#reinvent

@marknca tweeted at 30-Nov-2022, 16:50

NEW:

Amazon Athena for Apache Spark

• get started with interactive analytics on Apache Spark in under a second
• available today

#reinvent

@marknca tweeted at 30-Nov-2022, 16:51

RECAP:

Amazon Redshift Integration for Apache Spark

• run Apache Spark on Amazon Redshift data up to 10x faster vs. existing

more at : https://aws.amazon.com/blogs/aws/new-amazon-redshift-integration-with-apache-spark/

#reinvent

@marknca tweeted at 30-Nov-2022, 16:52

strong focus on @ApacheSpark this year

#reinvent

@marknca tweeted at 30-Nov-2022, 16:53

@SwamiSivasubram moving to performance at scale (in the foundations sections) now...

#reinvent

@marknca tweeted at 30-Nov-2022, 16:53

some crazy @awscloud scale highlights

#reinvent

@marknca tweeted at 30-Nov-2022, 16:54

more details on @awscloud DocumentDB at https://aws.amazon.com/documentdb/

#reinvent

@marknca tweeted at 30-Nov-2022, 16:55

@SwamiSivasubram calling out some of the challenges scaling DocumentDB. not enough capacity or performance in current cluster structures

#reinvent

@marknca tweeted at 30-Nov-2022, 16:56

NEW:

Amazon DocumentDB Elastic Clusters

• fully managed solution to scale document workloads of virtually any size and scale
• available today

#reinvent

@marknca tweeted at 30-Nov-2022, 16:56

call back to @awscloud Athena for Apache Spark. more details in this blog post: https://aws.amazon.com/blogs/aws/new-amazon-athena-for-apache-spark/

#reinvent

@marknca tweeted at 30-Nov-2022, 16:57

@SwamiSivasubram now into some customer scale examples

#reinvent

@marknca tweeted at 30-Nov-2022, 16:58

first customer speaker up now. Rathi Murthy from @Expedia

#reinvent

@marknca tweeted at 30-Nov-2022, 16:58

scale context for @Expedia

#reinvent

@marknca tweeted at 30-Nov-2022, 16:59

btw, @QuinnyPig’s thread on this keynote starts at https://twitter.com/QuinnyPig/status/1597993393740619778

#reinvent

@marknca tweeted at 30-Nov-2022, 16:59

👆 more colour, more snark, more of what’s going on in your 🧠 in @QuinnyPig’s thread

I tend to stick mainly to what’s on stage + adding in extra resources w/a little bit of Canadian 🇨🇦 colour 😉

#reinvent

@marknca tweeted at 30-Nov-2022, 17:01

back on stage, Rathi is explaining just how much data her teams are digging through

…it’s a lot. tons of interesting engineering and data science problems in there

#reinvent

@marknca tweeted at 30-Nov-2022, 17:01

nice shout out of the impact of travel on people, culture, and understanding

using data to drive better insights for ppl is what drives Rathi

#reinvent

@marknca tweeted at 30-Nov-2022, 17:03

btw, the @awscloud + @Expedia case study is up at https://aws.amazon.com/solutions/case-studies/expedia/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:04

Rathi is currently walking through the high level of price predictions and recommendations for travellers

#reinvent

@marknca tweeted at 30-Nov-2022, 17:05

the examples Rathi cites in this segment are really interesting. would’ve like to see some specific call outs about the challenges or a pointer to more technical follow-ups

@Expedia did a talk yesterday (CON322) but it was about #kubernetes

#reinvent

@marknca tweeted at 30-Nov-2022, 17:07

@SwamiSivasubram back up now talking about removing heavy lifting from customers

#reinvent

@marknca tweeted at 30-Nov-2022, 17:07

more on @awscloud DevOps Guru at https://aws.amazon.com/devops-guru/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:08

...

#reinvent

@marknca tweeted at 30-Nov-2022, 17:09

while other services are getting ml boosts, @awscloud SageMaker continues to do a massive amount of heavy lifting

more on SageMaker at https://aws.amazon.com/sagemaker/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:10

unstructureed data continues to be a persistent challenge for most organizations

@SwamiSivasubram its geospatial data as a real pain point

#reinvent

@marknca tweeted at 30-Nov-2022, 17:11

more on @awscloud SageMaker Ground Truth at https://aws.amazon.com/sagemaker/data-labeling/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:12

NEW

Amazon SageMaker now supports Geospatial ML

• making it easier to build, train, and deploy ml models using geospatial data 🌍

#reinvent

@marknca tweeted at 30-Nov-2022, 17:12

call back: more details on Amazon DocumentDB Elastic Clusters in this blog post https://aws.amazon.com/blogs/aws/announcing-amazon-documentdb-elastic-clusters/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:13

Kumar Chellapilla, GM ML/AI services @awscloud, up now to demo the new geospatial functionality

use case is predicting dangerous road contusion due to rising water levels

#reinvent

@marknca tweeted at 30-Nov-2022, 17:14

interesting demo using some built-in models & easily access 3rd party and open data sources

#reinvent

@marknca tweeted at 30-Nov-2022, 17:15

if my count is correct, Kumar is up to 4 different data sources added into this solution? that’s super cool!

#reinvent

@marknca tweeted at 30-Nov-2022, 17:17

looks like SUS201, Detecting deforestation with geospatial images and Amazon SageMaker, covers some of these topics

not sure if it includes the new features, but conceptually lots of overlap

seating is full, so catch it on YouTube sometime after Thursday

#reinvent

@marknca tweeted at 30-Nov-2022, 17:19

@SwamiSivasubram back up now, diving into reliability and security

#reinvent

@marknca tweeted at 30-Nov-2022, 17:19

lots of reliability and security features built into @awscloud services. some use cases need even more...

as @SwamiSivasubram foreshadows an announcement 😉

#reinvent

@marknca tweeted at 30-Nov-2022, 17:20

NEW:

Amazon Redshift Multi-AZ

• delivering high availability and reliability to support mission-critical analytics workloads

#reinvent

@marknca tweeted at 30-Nov-2022, 17:20

call back, here’s the blog post for @awscloud SageMaker geospatial data: https://aws.amazon.com/blogs/aws/preview-use-amazon-sagemaker-to-build-train-and-deploy-ml-models-using-geospatial-data/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:21

@SwamiSivasubram moving on to PostgreSQL security…

#reinvent

@marknca tweeted at 30-Nov-2022, 17:21

NEW:

Trusted Language Extensions for PostgreSQL

• new open-source project to support PostgreSQL extensions on Amazon RDS and Amazon Aurora
• available today!

#reinvent

@marknca tweeted at 30-Nov-2022, 17:23

on to the good ol’ reliable Shared Responsibility Model

#reinvent

@marknca tweeted at 30-Nov-2022, 17:24

…

#reinvent

@marknca tweeted at 30-Nov-2022, 17:24

NEW:

Amazon GuardDuty RDS Protection

• protect you data in Aurora with intelligent threat detection
• currently preview

#reinvent

@marknca tweeted at 30-Nov-2022, 17:25

I did not expect a #security launch during this keynote. really pumped about it.

@AWSSecurityInfo GuardDuty is absolutely crushing it!

#reinvent

@marknca tweeted at 30-Nov-2022, 17:26

need to focus on @SwamiSivasubram at the moment though. we’ve moved on to the connective tissue principle/aspect of a data strategy

this is the 2nd major pillar, we’re done with a data foundation for now

#reinvent

@marknca tweeted at 30-Nov-2022, 17:27

@SwamiSivasubram uses a really interesting real-world example of living root bridges. that bridges (see what I did there?) to:

• quality tools and data
• governance
• connectivity

#reinvent

@marknca tweeted at 30-Nov-2022, 17:29

…and now Amazon Security Lakes too!

more at https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-security-lake-preview/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:30

#protip: anytime you see the word “manual” on an @awscloud slide, you’re about to get something cool...

#reinvent

@marknca tweeted at 30-Nov-2022, 17:30

NEW:

AWS Glue Data Quality

• automatically measure, monitor, and manage data quality in your data lake
• available in preview today

#reinvent

@marknca tweeted at 30-Nov-2022, 17:31

👆 should’ve been called, “AWS Glue Happy Data Boo”

#reinvent

@marknca tweeted at 30-Nov-2022, 17:31

@SwamiSivasubram on to governance now

#reinvent

@marknca tweeted at 30-Nov-2022, 17:32

ohh, he said “manual” again…

#reinvent

@marknca tweeted at 30-Nov-2022, 17:32

more on @awscloud Lake Formation at https://aws.amazon.com/lake-formation/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:33

NEW:

Centralized Access Controls for Redshift Data Sharing

• govern access to Redshift data using AWS Lake Formation
• available in preview today

#reinvent

@marknca tweeted at 30-Nov-2022, 17:34

🧠 machine learning has it’s own unique set of governance challenges < a massive understatement

#reinvent

@marknca tweeted at 30-Nov-2022, 17:35

I also love how an hour in, @SwamiSivasubram’s smile is only getting wider. amazing energy

#reinvent

@marknca tweeted at 30-Nov-2022, 17:36

NEW:

Amazon SageMaker ML Governance

• governance and audibility for end-to-end ML development
• available today

#reinvent

@marknca tweeted at 30-Nov-2022, 17:37

@SwamiSivasubram recapping Amazon DataZone

more on the new service at: https://aws.amazon.com/datazone/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:38

Shikha Verma (@_Shikha_Verma_), Head of Product, Amazon DataZone up now for a demo

#reinvent

@marknca tweeted at 30-Nov-2022, 17:39

call back: the blog post for Trusted Language Extensions for PostgreSQL on Amazon Aurora is up now at https://aws.amazon.com/blogs/aws/new-trusted-language-extensions-for-postgresql-on-amazon-aurora-and-amazon-rds/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:40

@_shikha_verma_ is laying out the scenario for the demo. a data producer (sales team) needs to share data with a data consumer(marketing team) in order to complete a campaign analysis

#reinvent

@marknca tweeted at 30-Nov-2022, 17:41

I ❤️ the timeline view on the left of the slide. the screen captures could use a bigger scaling size to help with readability but @_Shikha_Verma_’s talk track is spot on

makes it easier to understand the advantages of DataZone

this demo is really well constructed

#reinvent

@marknca tweeted at 30-Nov-2022, 17:43

for reference, this demo starts around 1h 8m into the keynote

#reinvent

@marknca tweeted at 30-Nov-2022, 17:44

excellent demo. @_Shikha_Verma_ absolutely nailed it

the service looks cool tool, but this segment is worth studying if you ever give presentations

#reinvent

@marknca tweeted at 30-Nov-2022, 17:46

@SwamiSivasubram back up, talking about connected data sources

#reinvent

@marknca tweeted at 30-Nov-2022, 17:47

back on to ETL and “Zero ETL”

mirroring the “Zero Trust” #security push

#reinvent

@marknca tweeted at 30-Nov-2022, 17:48

re: Zero ETL

(or even Zero Trust)

#reinvent

@marknca tweeted at 30-Nov-2022, 17:49

though both concepts are excellent. I just get hung up on terms and how they get diluted over time as more and more ppl “bend” (being generous there) the term to server their needs…and sales

#reinvent

@marknca tweeted at 30-Nov-2022, 17:49

@SwamiSivasubram recaps the Amazon Aurora zero-ETLA integration with Amazon Redshift. more on that at https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-aurora-zero-etl-integration-redshift/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:50

NEW:

Amazon Redshift auto-copy from S3

• simplify and automate file ingestion into Redshift
• available in preview today

#reinvent

@marknca tweeted at 30-Nov-2022, 17:51

this slide is probably nicknamed, “Redshift all the thingz”

#reinvent

@marknca tweeted at 30-Nov-2022, 17:51

continuing the “weave” theme

#reinvent

@marknca tweeted at 30-Nov-2022, 17:52

more on Amazon Kinesis Data Firehose at https://aws.amazon.com/kinesis/data-firehose/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:52

more on Amazon SageMaker Data Wrangler at https://aws.amazon.com/sagemaker/data-wrangler/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:53

more on Amazon AppFlow at https://aws.amazon.com/appflow/

#reinvent

@marknca tweeted at 30-Nov-2022, 17:53

👆..and Amazon AppFlow just got 50+ new connectors. tons of really useful ones here for a lot of different customers

#reinvent

@marknca tweeted at 30-Nov-2022, 17:54

Amazon SageMaker Data Wrangler gets some of that 👆 goodness too. 40+ new data sources there

#reinvent

@marknca tweeted at 30-Nov-2022, 17:55

lots of connections to various data sources from various data sources…weave is definitely the correct word for this section

#reinvent

@marknca tweeted at 30-Nov-2022, 17:55

next customer speaker up. this time it’s Anna Berg Åsberg, global VP, R&D @AstraZeneca

#reinvent

@marknca tweeted at 30-Nov-2022, 17:56

Anna covering the @AstraZeneca @awscloud case: research at scale

#reinvent

@marknca tweeted at 30-Nov-2022, 17:59

remember that @aselipsky announced Amazon Omics during his keynote yesterday

more details at https://aws.amazon.com/omics/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:00

more from @awscloud + @AstraZeneca at https://aws.amazon.com/solutions/case-studies/astrazeneca/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:03

@SwamiSivasubram back up for the 3rd main pillar: democratize data

#reinvent

@marknca tweeted at 30-Nov-2022, 18:04

call back: the blog post for @awscloud Glue Data Quality is up now at https://aws.amazon.com/blogs/aws/join-the-preview-aws-glue-data-quality/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:05

call back: “AWS AI Service Cards” details at https://aws.amazon.com/blogs/machine-learning/introducing-aws-ai-service-cards-a-new-resource-to-enhance-transparency-and-advance-responsible-ai/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:06

back to the keynote, @SwamiSivasubram walking through the challenges around education and training for ML/data science

#reinvent

@marknca tweeted at 30-Nov-2022, 18:06

this is part of the first area of this section:

a wider net for innvation:

• education
• training
• low-code tools

#reinvent

@marknca tweeted at 30-Nov-2022, 18:07

to help address the education gap...

NEW

AWS Machine Learning University now provides educator training

• train educators in community colleges and MSIs nationwide
• available today

#reinvent

@marknca tweeted at 30-Nov-2022, 18:08

more details on the AI & ML scholarship program is available at https://aws.amazon.com/machine-learning/scholarship/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:10

@SwamiSivasubram points out that we need to help professionals get educated and train as well. lots going on there too

#reinvent

@marknca tweeted at 30-Nov-2022, 18:11

on to low-code and no-code tools now...

#reinvent

@marknca tweeted at 30-Nov-2022, 18:11

shout out for https://t.co/jIzVGVd3kJ. lots of new features have been added this year and this week

#reinvent

@marknca tweeted at 30-Nov-2022, 18:13

more on @awscloud SageMaker Canvas at https://aws.amazon.com/sagemaker/canvas/

#reinvent

@marknca tweeted at 30-Nov-2022, 18:14

understand but don’t like the focus on no-code/low-code tools for builders who don’t write code

I’ve been coding for a very long time & I ❤️ this type of tooling. it’s a level of automation

these tools speed up my solutions, let me code only the really tough bits

#reinvent

@marknca tweeted at 30-Nov-2022, 18:16

@SwamiSivasubram back up after a good WarnerBros gaming video. Swami is retiring the three main pillars of today’s keynote

• build future-proof foundations
• weave connective tissue
• democratize data

#reinvent

@marknca tweeted at 30-Nov-2022, 18:17

no surprise, @SwamiSivasubram ends it with a smile!

#reinvent

@marknca tweeted at 30-Nov-2022, 18:18

that’s it for the data/ml keynote. the partner keynote is up later on today

remember that session are being uploaded to the @AWSEvents YouTube channel (https://www.youtube.com/@AWSEventsChannel) regularly

/🧵 #reinvent

@marknca tweeted at 30-Nov-2022, 18:19

👆 Start