Monday Night Live With Peter DeSantis
At re:Invent or attending remotely? Check out my “Ultimate Guide to AWS re:Invent 2022” post for some tips and tricks to get the most out of the show.
Monday Night Live with Peter DeSantis is always a fantastic talk. Peter talks us behinds the scenes of AWS and shows how various technical improvements are enabling the features and functionality that we know and love.
I live tweeted the keynote. Frustratingly in a split thread, but here are both parts…
First Twitter Thread π§΅
a π§΅π (/cc @AWSEvents)
@marknca tweeted at 29-Nov-2022, 03:31
Tweet 2/3 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:33
Tweet 3/3 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:34
Second Twitter Thread π§΅
Peter reminds us it’s not all about what you can see
“Great performance is the result of innovation from the ground up and investing over time”
#reinvent
@marknca tweeted at 29-Nov-2022, 03:35
Tweet 2/71 π Next tweet π Start
more on Nitro at https://aws.amazon.com/ec2/nitro/
#reinvent
@marknca tweeted at 29-Nov-2022, 03:36
Tweet 3/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:37
Tweet 4/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:39
Tweet 5/71 π Next tweet π Start
C7gn
uses the new Nitro v5 chip under the hood. lots of benefits. tip of the iceberg here
#reinvent
@marknca tweeted at 29-Nov-2022, 03:40
Tweet 6/71 π Next tweet π Start
Graviton3E
custom tuned Graviton3 silicon. lots of benefits for the targeted use cases
#reinvent
@marknca tweeted at 29-Nov-2022, 03:41
Tweet 7/71 π Next tweet π Start
HPC7g
β¦combines the Graviton3E + Nitro v5 for some big boosts for HPC applications
#reinvent
@marknca tweeted at 29-Nov-2022, 03:42
Tweet 8/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:42
Tweet 9/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:43
Tweet 10/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:44
Tweet 11/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:45
Tweet 12/71 π Next tweet π Start
specifically talking about SRD (scalable reliable datagram)
more on that at: https://aws.amazon.com/blogs/hpc/in-the-search-for-performance-theres-more-than-one-way-to-build-a-network/
#reinvent
@marknca tweeted at 29-Nov-2022, 03:46
Tweet 13/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:46
Tweet 14/71 π Next tweet π Start
tl:dr it works great, but focuses on βgetting thereβ vs. performance
at @awscloud scale, they need something more efficient and focused on hyper scale issues
#reinvent
@marknca tweeted at 29-Nov-2022, 03:48
Tweet 15/71 π Next tweet π Start
- multi-pathing
- retries in microseconds
- runs on nitro (dedicated hardware)
#reinvent
@marknca tweeted at 29-Nov-2022, 03:49
Tweet 16/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:49
Tweet 17/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:51
Tweet 18/71 π Next tweet π Start
β¦btw, all new EBS io2 volumes will get this performance boost in the new year (stay tuned, they are just saying βcoming soon")
#reinvent
@marknca tweeted at 29-Nov-2022, 03:54
Tweet 19/71 π Next tweet π Start
ENA Express, brings SRD to ENAβ¦available today!
more details on ENA (basic, not express): https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/enhanced-networking-ena.html
#reinvent
@marknca tweeted at 29-Nov-2022, 03:55
Tweet 20/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:55
Tweet 21/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:56
Tweet 22/71 π Next tweet π Start
π€¦π€¦π€¦
@marknca tweeted at 29-Nov-2022, 03:57
Tweet 23/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 03:57
Tweet 24/71 π Next tweet π Start
would have been better if he drove it out on stage π
#reinvent
@marknca tweeted at 29-Nov-2022, 03:58
Tweet 25/71 π Next tweet π Start
they need more performance (processing, storage, network, etc.) in order to train properly. @awscloud innovations in performance engineering like SRD are helping drive these advances
#reinvent
@marknca tweeted at 29-Nov-2022, 03:59
Tweet 26/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:01
Tweet 27/71 π Next tweet π Start
that said, numbers and more specifics would actual make these slides weaker and muddle the point Peter is making
#reinvent
@marknca tweeted at 29-Nov-2022, 04:03
Tweet 28/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:04
Tweet 29/71 π Next tweet π Start
more on that chip at https://aws.amazon.com/machine-learning/trainium/
#reinvent
@marknca tweeted at 29-Nov-2022, 04:05
Tweet 30/71 π Next tweet π Start
you know, because MATH! π€£
#reinvent
@marknca tweeted at 29-Nov-2022, 04:06
Tweet 31/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:06
Tweet 32/71 π Next tweet π Start
π€£π€£π€£
#reinvent
@marknca tweeted at 29-Nov-2022, 04:08
Tweet 33/71 π Next tweet π Start
basically: many hands make light work?
#reinvent
@marknca tweeted at 29-Nov-2022, 04:10
Tweet 34/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:11
Tweet 35/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:12
Tweet 36/71 π Next tweet π Start
β¦as long as you donβt give 9 to the race of man, 3 to the Elves, 7 for the Dwarves, and one to Sauron π€¦
#reinvent
@marknca tweeted at 29-Nov-2022, 04:15
Tweet 37/71 π Next tweet π Start
Trn1n
- faster networking
- faster training
#reinvent
@marknca tweeted at 29-Nov-2022, 04:16
Tweet 38/71 π Next tweet π Start
more details on @awscloud + F1 at https://aws.amazon.com/sports/f1/
#reinvent
@marknca tweeted at 29-Nov-2022, 04:17
Tweet 39/71 π Next tweet π Start
(somewhere @mosescj58 just felt a chill π€£)
#reinvent
@marknca tweeted at 29-Nov-2022, 04:18
Tweet 40/71 π Next tweet π Start
itβs an AI/ML tool that provides more accurate data fasterβ¦and more importantly with less weight
β¦would love to see more technical details on that one
#reinvent
@marknca tweeted at 29-Nov-2022, 04:19
Tweet 41/71 π Next tweet π Start
check out his thread at https://twitter.com/QuinnyPig/status/1597430775330537472?s=20&t=reKJgcbkR9LjU2gLMZeRXg
#reinvent
@marknca tweeted at 29-Nov-2022, 04:22
Tweet 42/71 π Next tweet π Start
lots of engineering challenges and trade offsβ¦
#reinvent
@marknca tweeted at 29-Nov-2022, 04:23
Tweet 43/71 π Next tweet π Start
Jock is constantly calling out the sheer number of decisions the team needs to make. they need data & analysis to make those decisions
#reinvent
@marknca tweeted at 29-Nov-2022, 04:25
Tweet 44/71 π Next tweet π Start
β¦was hoping for an engineering data app like the real time MLB analysis: https://aws.amazon.com/blogs/machine-learning/calculating-new-stats-in-major-league-baseball-with-amazon-sagemaker/
..itβs not that, but Iβm sure F1 fans will enjoy it
#reinvent
@marknca tweeted at 29-Nov-2022, 04:26
Tweet 45/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:27
Tweet 46/71 π Next tweet π Start
π¬π€£
#reinvent
@marknca tweeted at 29-Nov-2022, 04:27
Tweet 47/71 π Next tweet π Start
thanks again @timallenwagner for setting us on this path!
#reinvent
@marknca tweeted at 29-Nov-2022, 04:28
Tweet 48/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:29
Tweet 49/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:30
Tweet 50/71 π Next tweet π Start
Tweet 51/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:31
Tweet 52/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:31
Tweet 53/71 π Next tweet π Start
Tweet 54/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:32
Tweet 55/71 π Next tweet π Start
think of it as a cache. a big pool of compute
#reinvent
@marknca tweeted at 29-Nov-2022, 04:33
Tweet 56/71 π Next tweet π Start
if a VM is up for the customer function, great. if not, initialize a new instance (empty & waiting) to handle it >> a/k/a cold starts
β¦it works, but thereβs room for improvement
#reinvent
@marknca tweeted at 29-Nov-2022, 04:34
Tweet 57/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:35
Tweet 58/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:36
Tweet 59/71 π Next tweet π Start
thatβs more expensive and less efficient
enter Firecracker
#reinvent
@marknca tweeted at 29-Nov-2022, 04:37
Tweet 60/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:37
Tweet 61/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:38
Tweet 62/71 π Next tweet π Start
numbers would be helpful here. Peter mentioned one but Iβm not sure I heard it right
assumption: things got better with the move to Firecracker
#reinvent
@marknca tweeted at 29-Nov-2022, 04:39
Tweet 63/71 π Next tweet π Start
need to make them faster. where is that time going?
for Java devs? a lot of it is in initialization
#reinvent
@marknca tweeted at 29-Nov-2022, 04:41
Tweet 64/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:42
Tweet 65/71 π Next tweet π Start
bye bye cold startsβ¦at least most of them
#reinvent
@marknca tweeted at 29-Nov-2022, 04:43
Tweet 66/71 π Next tweet π Start
- some cryptography use cases where uniqueness is required
- can adjust with code changes
#reinvent #serverless
@marknca tweeted at 29-Nov-2022, 04:45
Tweet 67/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:46
Tweet 68/71 π Next tweet π Start
get the pieces needed to start the function up and running as quickly as possibleβ¦before itβs even asked for
#reinvent
@marknca tweeted at 29-Nov-2022, 04:48
Tweet 69/71 π Next tweet π Start
#reinvent #serverless
@marknca tweeted at 29-Nov-2022, 04:49
Tweet 70/71 π Next tweet π Start
#reinvent
@marknca tweeted at 29-Nov-2022, 04:50
Tweet 71/71 π Next tweet π Start
lots of great advancements & engineering work to deliver more features & functionality to builders
β¦more tomorrow as #reinvent kicks into high gear!
@marknca tweeted at 29-Nov-2022, 04:51