#308: Docker for Python Developers (2021 Edition) Transcript

00:00 Docker is one of the core elements of developing Python applications in consistent ways, as well as running them across different hardware universally.

00:07 On this episode, you'll meet Peter McKee from Docker.

00:10 He's here to catch us up on what's happening in the Docker universe for Python developers.

00:15 This is Talk Python to Me, episode 308, recorded March 9th, 2021.

00:20 Welcome to Talk Python to Me, a weekly podcast on Python, the language, the libraries, the ecosystem, and the personalities.

00:40 This is your host, Michael Kennedy.

00:42 Follow me on Twitter, where I'm @mkennedy, and keep up with the show and listen to past episodes at talkpython.fm,

00:48 and follow the show on Twitter via at Talk Python.

00:51 This episode is brought to you by Datadog and us over at Talk Python Training.

00:55 Please check out what we're offering during our segments.

00:58 It really helps support the show.

00:59 A little bit of news.

01:01 We just released not one, but two new courses, and more are just around the corner.

01:05 You might remember my interview with Sebastian Vipovsky over on episode 279,

01:10 where we discussed the modern Python developers toolkit.

01:12 Since then, he and I have teamed up to bring you this whole idea of modern tools

01:16 applied to well-structured Python projects as a course.

01:19 And we just released it.

01:20 It's called Modern Python Projects.

01:22 You can find it over at talkpython.fm/modern dash python dash projects, or you'll find the link in the show notes.

01:28 If you like the idea of a total tool chain makeover for how you're building your Python projects and applications,

01:33 be sure to drop by the course page and watch the overview video to see if it's right for you.

01:37 I'm sure everyone will learn something interesting in this course.

01:40 There's so many cool things in here, no matter your experience level.

01:43 Another new course we just launched is full web apps with FastAPI.

01:47 FastAPI is definitely the framework with the most energy lately.

01:51 But if you build your APIs with FastAPI, well, you need another framework for your HTML user interaction side.

01:56 In other words, could you replace Flask or Django with FastAPI?

02:00 The answer is yes.

02:01 And this course is your guide to doing so.

02:03 Check it out at talkpython.fm/fastapi dash web.

02:07 Link in the show notes.

02:08 I'm really excited about these two courses, and I hope you all love them.

02:11 We'll be giving away five tickets to attend PyCon US 2021.

02:16 This conference is one of the primary sources of funding for the PSF, and it's going to be held May 14th to 15th online.

02:23 And because it's online this year, it's open to anyone around the world.

02:27 So we decided to run a contest to help people, especially those who have never been part of PyCon before,

02:32 attend it this year.

02:33 Just visit talkpython.fm/PyCon 2021 and enter your email address, and you'll be in the running for an individual PyCon ticket.

02:41 Compliments of Talk Python.

02:43 These normally sell for about $100 each.

02:46 And if you're certain you want to go, I encourage you to visit the PyCon website,

02:49 get a ticket, and that money will go to support the PSF and the Python community.

02:53 Congratulations to Tammy Doe.

02:56 Tammy won the second of five tickets we're giving away, and there's still more chances to win.

03:00 If you want to be in this drawing, just visit talkpython.fm/PyCon 2021.

03:04 Enter your email address.

03:06 You'll be in the running to win a ticket.

03:08 Now, let's get on to that interview.

03:10 Peter, welcome to Talk Python to me.

03:13 Yeah, thanks for having me.

03:14 Great to be here.

03:15 Hey, it's really great to have you here as well.

03:17 It's been far too long since we've talked containers and Docker and all the things.

03:21 I was looking back at something like Show 9 or something like that.

03:24 It was, I believe, 2015.

03:26 Has anything changed with Docker since 2015?

03:28 I suspect something has.

03:30 Yeah, containers are interesting.

03:32 They're moving very fast, right?

03:34 Very fast.

03:35 On just about all fronts, I think the whole developer, DevOps, DevSecOps, you know, just have embraced it the past five years.

03:42 Yeah, I was thinking what you might respond to from that question.

03:45 And to me, it seems like not so much how containers work and run, but just how people have embraced them and how many places they show up and how many people are saying, hey, hey, we have a cluster.

03:56 You just run your thing over here.

03:58 Just give us your container and we'll help you run it as part of our platform as a service or whatever it is they're cloud hosting.

04:03 Yeah.

04:04 Yeah, it's very interesting.

04:05 And then there's all these little micro, maybe micro is not the correct term, but all these, a lot of SaaS and startups and trying to help.

04:12 And containers are at the core of a lot of that.

04:15 If you get in a container, we can run it.

04:17 And yeah, some really interesting SaaS as they're starting up, little niche platforms as a service type things.

04:22 Yeah, 100%.

04:23 Yeah, absolutely.

04:24 It's super interesting.

04:25 Before we dive too deep into that, though, let's get started with your story.

04:28 How did you get into programming?

04:30 As a kid, my dad's an accountant, but a nerd at heart, you know, a techie, let's say.

04:35 And he started out, this is interesting, at least to me, he started out with calculators before PCs were a big thing.

04:41 He had calculators and he programmed these calculators and stuff.

04:44 And anyways, long story short, he ended up getting, I think it was Apple II was the first kind of computer we had.

04:50 And I was fascinated about it, started programming on it, just learning, messing around.

04:54 Fast forward after high school, I was in the Coast Guard and had gotten out and was going back to school.

05:00 And, you know, I started back as an accountant.

05:02 My dad said, hey, accounting is a good foundation, like math and science and those type of things.

05:06 And I hated it, hated it, debits and credits.

05:10 And I was just like micro Mac record.

05:13 Yeah, exactly.

05:14 Now it's very, yeah, now it's a lot more interesting.

05:16 Back then I couldn't stand it.

05:17 But then I lucked out.

05:19 My father was running two steel companies and he had a consulting team that was writing software for him, you know, like very exciting stuff.

05:26 Like inventory management, work in process tracking.

05:29 It's not exciting, but it's the kind of stuff that if you looked at what people were doing before, it was dreadful, right?

05:35 It was like transformative, even though it seems so boring and basic.

05:37 Yeah.

05:38 Yeah.

05:39 And he said, why don't you come work for me?

05:41 And this consulting firm, the main, the owner had some life issues or whatever and had to move on.

05:46 And I said, well, I don't, you know, I don't know what I'm doing.

05:50 He said, oh, you'll figure it out.

05:51 There's a big Barnes and Noble at the top of the hill there.

05:54 You can.

05:54 They got a whole section on it.

05:55 Just go read it.

05:56 Yeah.

05:56 Literally.

05:57 Yeah.

05:57 And, and I did, and I did.

05:59 And, you know, it was, I had a passion.

06:01 I had a burning desire, right?

06:02 To learn.

06:03 It was fascinating to me.

06:04 Yeah.

06:05 And so I switched over a computer science degree, MIS.

06:07 And, but by the time I got farther along than that, I was getting paid to program and I was learning a ton more on the job.

06:14 So that kind of started my career.

06:16 Do you remember your first experience of getting paid to write code?

06:18 Was it just like, I can't believe they're actually paying me to do this?

06:21 Absolutely.

06:22 Absolutely.

06:22 It was.

06:23 Yeah.

06:23 I mean, it's literally how they say, you know, find something you love and are passionate in and the money will come.

06:28 And yeah, it did.

06:29 It certainly did.

06:30 I was, I really enjoyed it.

06:31 And yeah, I was getting paid to learn and write applications.

06:35 So yeah, it was, it was awesome.

06:37 It was awesome.

06:37 Yeah.

06:37 It's fantastic.

06:38 I remember my first experience like that as well.

06:40 I'm like, I had better figure this out before they realized I can't actually do this stuff.

06:43 Yeah.

06:44 I could do the things they want if I'm like, oh, any moment they're just going to say, no, if you actually don't get to do this anymore.

06:49 But it was, it was great.

06:50 Yeah.

06:50 Yeah, exactly.

06:52 By that time I said, you know, I have to get on a bigger team and learn.

06:54 I know I got to the point where, okay, I can write programs, but I don't know how to be an engineer.

06:58 And I'm not sure I could put it in those type of words.

07:01 But, but luckily after that, I got on a team and had some great mentors.

07:04 So yeah, that's, that's how I kind of got started.

07:07 Yeah.

07:07 Fantastic.

07:08 I think that's good advice.

07:09 You know, it's, it's really cool to be on small teams because you really get to put your hand in so many areas.

07:15 You're not pigeonholed into, well, I'm the one who optimizes a stored procedure.

07:18 So I do that.

07:19 Right.

07:19 You know, you get like a really broad experience, but at some point when it's like, I'm, there's no one I can talk to or learn from to go farther in this.

07:28 Then it gets to be a little bit limiting, I think.

07:31 Yeah, exactly.

07:32 Like, well, that's how it got for me.

07:33 I was like, I don't know where to go next.

07:35 And I don't know who, you know, I didn't have anybody there with me.

07:37 Yeah.

07:38 I think having a mentor either, you know, well-structured or kind of loosely structured or whether you look back on it five years and go, oh, that person was kind of mentor for me.

07:46 It's very powerful.

07:47 Right.

07:47 It's very powerful.

07:48 Yeah.

07:48 Yeah, absolutely.

07:49 It totally is.

07:50 I remember making that transition to a really great group of people who were, every one of them I felt like was way smarter than me.

07:56 It was intimidating, but absolutely was a good outcome.

08:00 Yeah.

08:00 That's the place to be.

08:01 Right.

08:01 Unless, you know, of course, I think a lot of us too in tech deal with the ego issue sometimes.

08:06 I know I did.

08:07 Right.

08:07 Like, hey, I'm pretty smart.

08:08 I know what I'm doing.

08:09 Then you, when you're young and ambitious, right.

08:11 And you run into other really smart people that like are smart and you go, okay, I'm not that smart.

08:17 Yeah.

08:18 It's a little humbling, but it can be humbling.

08:20 Yeah.

08:20 Those are probably good life lessons, but they're hard to take when you're young.

08:23 I remember.

08:24 Yeah, absolutely.

08:24 Yeah.

08:25 Fantastic.

08:26 So how about now?

08:27 What are you doing day to day?

08:28 Yeah.

08:28 So I head up the developer relations team at Docker and I get to do what I love.

08:32 You know, I still get to play around with tech and learn new things and build stuff.

08:37 But then I also get to transfer that knowledge to others or at least try.

08:40 So teaching and mentoring is what I do mostly day to day, right?

08:44 Content and workshops and those types of things.

08:46 I help folks learn to use containers and Docker to help build applications.

08:50 Right.

08:51 So, yeah, it's fantastic.

08:53 I love my job.

08:54 Truly do.

08:55 I can imagine.

08:56 You know, I really have thought for a long time that this developer evangelist sort of

09:01 role just seems so neat because you get to work with a bunch of people.

09:05 You're not really there just closing boring JIRA tickets every day, right?

09:09 You get to just work at like the fun level of software and really interact with a lot of

09:13 different people.

09:14 You get to go to conferences, maybe be on a podcast, all those kinds of things.

09:17 I just, it's a really cool space to be after you've learned enough in the industry to play

09:22 that role.

09:23 Yeah.

09:23 A hundred percent.

09:23 I remember seeing, I had thought about the role before, but I think I was at Google's,

09:28 what is it?

09:29 Google Next.

09:30 I think it's their conference.

09:31 And that was when I kind of, I had known about Dev Advocates and DevRel, but when I saw

09:35 a couple speak, I was like, oh wait, Dev Advocates.

09:37 Oh, they get paid to do this.

09:39 This isn't just, you know, Peter, who's a software engineer, then speaks, right?

09:43 This is their job.

09:44 And I was like, oh, that's, that's pretty interesting.

09:46 Yeah.

09:46 Yeah.

09:46 Yeah.

09:47 It's, I think you got to have the right personality for it, but I think it's really fantastic.

09:50 I did actually a whole episode, episode 189 on this role.

09:55 And I had four or five people who were at different companies doing this.

09:59 So yeah, I was, it's really, really neat.

10:00 So, you know, I do want to catch up on what is new and Docker and containers in that whole space,

10:06 but there are a lot of people with lots of different backgrounds.

10:09 Let's, you know, listen to the show who I'm sure everyone's heard of Docker and

10:13 containers, right?

10:14 It's like hearing of Linux or something, but that doesn't mean you're super familiar

10:17 with it or you really understand the advantages or maybe the history.

10:19 So let's actually maybe start with just like the history of containers a little bit.

10:24 I know when I first saw the talk by the original, I think it was the original CEO of Docker,

10:31 he had a really interesting sort of tie back to shipping containers.

10:35 Yeah.

10:36 So what's this whole idea of containers?

10:37 Where's it come from?

10:38 What's the deal?

10:39 Yeah.

10:39 Solomon Hikes.

10:40 Yeah, that was him.

10:41 When I first saw his, I think it was at a Pi conference.

10:44 Now that I think about it, actually in Europe.

10:45 Yeah.

10:46 He gave a quick brief, kind of like what do you call lightning talk, right?

10:50 And it kind of went over at the end and people like went kind of crazy.

10:54 And I remember kind of seeing it and I was like, and if you ever go watch it, I recommend people

10:58 go watch it and kind of look for the aha moment.

11:00 At least it took me a bit, right?

11:02 And, you know, he did ran these commands and then, oh yeah.

11:04 And then there's this process running inside of a container and super easy.

11:07 And I forget what he demoed, but it took me a while, right?

11:11 To be honest, right?

11:11 I stepped back and said, well, okay, we have VMs.

11:14 What is this container thing?

11:15 And it took me a little bit to figure out like, oh wow, this is super powerful.

11:18 But, you know, containers that the constructs to build containers have been around for a while

11:23 since the seventies, right?

11:25 And been in Unix, different Unix flavors with change root and those type of things.

11:29 And then I think around 2000, I believe was when vServe came out and then about eight years.

11:38 So you had Linux vServe and FreeBSD had some, you know, container-like functionalities to isolate

11:44 processes into those type of things.

11:47 So vServe was kind of like a virtual, you know, sitting on top of the core kernel and having

11:51 some virtualization there.

11:52 I'll put virtualization.

11:53 Yeah, when I first heard about Docker, I thought, oh, this is this amazing new thing.

11:57 And then as I researched it more, I'm like, actually this, the pieces had always, not always,

12:02 but they had been there for a while.

12:03 Like these pieces you're talking about, they just hadn't really been put into a nice little

12:07 package the way Docker has, right?

12:09 Yeah.

12:09 Yeah.

12:09 And I think that's the beauty of what Docker did and Solomon and his team, right?

12:13 There was, I think there was three founders, but yeah, two is, was it 2013?

12:18 There it is on the screen.

12:19 Yeah.

12:19 So 2013 Docker kind of took off, right?

12:22 It kind of exploded and it was just that.

12:23 And I, you know, they simplified containers.

12:25 These constructs were all there, but they made it easy.

12:27 The ability to deep, you know, drop back down in, into the details or stay very high level

12:32 and use, you know, Docker run, Docker push, you know, those Docker build, right?

12:37 Those three main commands were super powerful.

12:40 And I think that was the beauty of Docker.

12:41 They just made it easier for the average developer or, you know, for, if you had to be a Linux kernel

12:47 developer to kind of really understand containers before that.

12:50 Yeah.

12:51 And they simplified it.

12:52 Yeah.

12:52 Linux admin or something like that, right?

12:55 Yeah.

12:55 Yeah.

12:55 A hundred percent.

12:55 And it's kind of like, I think Microsoft did a great job at this.

12:59 I think Apple has done a great job at this, you know, Microsoft with, you know, VB, right?

13:03 And I'm going to get beat up on the internets for this visual, visual basic, but visual basic

13:08 six, I mean, kind of weird, but it was a game changer, right?

13:11 You had C++ MFC, you know, writing these C++ to write desktop apps and business apps.

13:17 Right.

13:17 And VB6 came along and said, oh no, no, it's, you know, if you need a text box and

13:21 some labels and a button, just drag it on there.

13:22 Right.

13:23 Look, I won't beat you up for that.

13:24 VB was transformative.

13:25 It was magical.

13:27 Yeah.

13:27 The problem with VB was you could go so far and then you're like, well, VB doesn't do that.

13:32 So now you, now you get a grownup.

13:34 Now it's time to put your big boy pants on and get a grownup language and suffer the,

13:38 you know, C++ huge gap.

13:40 But for what you, a lot of people built with that, it was incredibly easy.

13:44 To be honest, there's nothing like that today that I can think of.

13:47 That is so powerful for building a little distributable application I can give to you.

13:52 Yeah.

13:52 Electron feels super complicated and hard.

13:55 Python, you can build stuff, but it's always kind of like, but this is a challenge or that,

13:59 you know, even though the windows stuff with WPF is, it's way more complicated than like,

14:06 it was magic, right?

14:07 It's just, it's too bad that there's not sort of a semi-modern version of something that

14:12 simple for people.

14:13 Yeah.

14:14 And if, who knows if, if Visual Basic had curly braces, we might have a different story.

14:18 I mean, like, like truly, right?

14:21 I mean, I remember having debates with, yeah, what's not a real language?

14:24 It's, you know, it's basic.

14:26 It's the basic programming language, right?

14:27 But yeah.

14:28 Yeah.

14:28 Yeah.

14:28 Yeah.

14:29 And John Sheen out there in the live stream says, rad concepts seem to be coming back as

14:33 these low code, no code platforms.

14:34 That's a really interesting tie in there.

14:36 I do agree with that.

14:38 I think that they've gone even lower than, or simpler than what Visual Basic was to like

14:42 really, really simple.

14:43 So yeah, I'm not sure it's exactly equivalent, but it's definitely, you're right.

14:47 Those things are definitely coming back.

14:48 Yeah.

14:48 I think we were real complicated.

14:50 Now we're going real too simplifying, right?

14:52 The pendulum swings hard.

14:54 Yeah.

14:54 I think we'll find it.

14:55 I do believe though, with technology, right?

14:58 Abstractions get higher and higher.

14:59 And well, this will kind of roll in a little bit into where the container history went

15:03 next.

15:04 And, you know, 2017, 18-ish, Kubernetes kind of dominated the orchestration, right?

15:11 And still does.

15:12 But it is, I was going to say horribly complex.

15:15 And maybe it is, maybe I'll get beat up for that too.

15:17 But it is extremely complex, right?

15:20 Extremely complex.

15:21 And you're mostly talking about like running a Kubernetes cluster is complex.

15:26 Not necessarily like somebody's already set up for you and you give them a-

15:29 of a definition and say, run that.

15:31 Like that part might not be so hard, but like if you're going to do the whole stack, right?

15:34 Yeah.

15:34 The whole stack from the ground up, right?

15:36 Yeah.

15:36 So it's a bunch of moving parts, getting installed, getting everything working together.

15:39 Security, networking.

15:41 Yeah.

15:41 It's not simple, right?

15:44 It's not simple at all.

15:45 This portion of Talk Python to Me is brought to you by Datadog.

15:49 Are you having trouble visualizing latency and CPU or memory bottlenecks in your app?

15:54 Not sure where the issue is coming from or how to solve it?

15:57 Datadog seamlessly correlates logs and traces at the level of individual requests, allowing

16:02 you to quickly troubleshoot your Python application.

16:05 Plus, their continuous profiler allows you to find the most resource-consuming parts of

16:09 your production code all the time at any scale with minimal overhead.

16:13 Be the hero that got that app back on track at your company.

16:16 Get started today with a free trial at talkpython.fm/Datadog, or just click the link in your

16:22 podcast player's show notes.

16:23 Get the insight you've been missing with Datadog.

16:26 I think it'll get easier and easier and easier and orchestrated run times.

16:31 You know, I see a lot in tech, like the app engine from Google with Python, right?

16:36 Well, basically serverless now.

16:37 But when it first came out, you're like, what, you're going to run my whole app?

16:41 No, no, no, no, no.

16:41 I need to control all that.

16:42 Yeah.

16:43 So we did away with it.

16:44 But now we're coming back.

16:44 You know, serverless, we're kind of coming back to it.

16:46 Same with Kubernetes, right?

16:47 Oh, you're ECS and ACI on, you know, hey, give me a container.

16:52 I'll just run it and manage it.

16:53 You know, we said, no, no, no, no.

16:54 I need to control all that.

16:55 And then you get this massive Kubernetes.

16:57 And now I think we're going back, right?

16:59 Yeah.

17:00 I just want to give you my containers and run them for me, right?

17:02 I don't have time to deal with all this.

17:04 And Google's and Google announced autopilot and those type of things, right?

17:08 So I think that's the way we're going to go.

17:09 And I think Docker as a company, about a year ago, when we sold off the enterprise, a little

17:14 over a year ago, sold the enterprise business off, got a kind of package software, enterprise

17:18 software, moved more to SaaS, back to developers.

17:21 Yeah.

17:22 Well, let's dig into that for a minute, because I remember seeing Docker coming along and it

17:26 was like, oh, this is a really cool, really cool dev tool.

17:28 But how are they going to make any money out of this?

17:30 And I feel like the first big step was, well, what we're going to do is we're going to have

17:34 special offerings for enterprises and help them tame their zillions of different types

17:40 of software they need to run.

17:41 It sounds like that that's not the case anymore.

17:43 What's that transition?

17:43 What's happened with Docker around that?

17:45 I think first the business model was we shifted to an enterprise business model.

17:49 Prior to that, Docker was just exploding, right?

17:51 And building tools and every Docker con, there was a new release and a new tool.

17:55 And a lot of them would fizzle out and stuff like that.

17:58 And the people with the purse strings, the money said, hey, hold on, this is great.

18:02 You're doing some wonderful things.

18:03 But we want our money back eventually.

18:05 So can you go sell something?

18:08 And they probably-

18:09 Open source and Cumbia, we all love it.

18:11 But we're investors.

18:13 Where's our 10X?

18:14 Yeah.

18:14 Yeah.

18:14 So we shifted a little bit to enterprise.

18:16 And it was just an old business model, I think.

18:18 On-prem, long licenses, three-year licenses, at least a year, if not three years.

18:24 And then consulting on top of that.

18:26 So paying a couple of hundred thousand dollars for the software and then twice that for consulting

18:31 services.

18:32 It was just a model that's a little bit outdated.

18:34 And it's still there, of course.

18:36 But Salesforce was really the first that kind of was starting to drive the nail into the coffin,

18:41 so to speak, right?

18:42 Well, it seems to me where a lot of those stories are moving are, are you moving to Azure?

18:48 Are you moving to AWS?

18:50 Are you moving to Linode?

18:51 Instead of trying to solidify and really modernize the data center inside companies, a lot of them

18:57 are going, how can we just get out of the data center business?

18:59 In which case, that's a totally different story, right?

19:02 In terms of how they work with you guys.

19:04 We did have an advantage, you know, cross cloud, one single plane of glass for all your containers

19:08 across clouds, internal, external.

19:10 But it was just, it was a day late and a dollar short with funding when we kind of tried to

19:15 do that.

19:16 And yeah, so they sold off the enterprise business and focused back on what Docker does

19:20 really well is build development tools, development experiences, making container development first

19:26 really easy, right?

19:28 And that's kind of what we're focused on.

19:29 We call it shift left, right?

19:31 Focusing back on the developer.

19:32 We're still very interested in ops and DevOps and DevSec ops, but more from a developer's perspective

19:38 and not that day two long-term running your production environments and stuff.

19:42 Yeah.

19:43 And so we got small again, got focused again.

19:46 You know, we have something like 10 million developers or 10 minute desktop installs, you

19:51 know, billions of images being pulled out of Hub and kind of looked at it and said, hey, there's

19:56 a business here, right?

19:57 Just official images on Hub is a huge, huge asset for us, right?

20:01 You know, with Python and packages and all the languages and runtimes, right?

20:06 To get really good, high quality scanned packages is hard, right?

20:11 And Hub does that.

20:12 So you know where you're getting your Mongo database from, who's produced it.

20:16 Docker kind of puts their stamp on it.

20:17 Okay.

20:17 So you guys have like officially verified, certified, either direct images or Docker files that build

20:24 the images out there?

20:25 Yeah.

20:25 Yeah.

20:26 So we have official images, which we kind of say, hey, this is following best practices.

20:30 This is, you know, been scanned for security vulnerabilities.

20:33 That doesn't mean there's not security vulnerabilities in there.

20:35 If anybody works in the security space, right?

20:38 That's like impossible.

20:39 Yeah.

20:40 Lowers your attack surface.

20:42 This is the, we're recording this the week that we're basically hearing, you know, 60,000

20:46 direct companies have been compromised by the Microsoft Exchange vulnerability.

20:51 And then they're probably providing products to others, right?

20:53 Like it's, it's tough.

20:54 Yeah.

20:55 Yeah, it is.

20:56 But at the same time, there's also a lot of news around supply chain vulnerability.

21:00 And the SolarWinds thing was a supply chain vulnerability.

21:03 I don't believe the, you don't know, but I don't believe the exchange one was.

21:07 But, you know, Docker is certainly part of that supply chain, either strengthening or weakness

21:12 there, right?

21:13 Like we hear about how PyPI and NPM and RubyGems and all of those have people have been, you know,

21:18 putting renewed interest in trying to get bad things into there.

21:21 I always have the same thought about Docker if I just grab an arbitrary Docker file off

21:27 the internet because, oh, look, this configures the thing that I need.

21:29 And I Docker build Docker run.

21:31 Well, it might be configuring it with extra goodies for someone else right in there.

21:35 Right.

21:35 And so that sounds like a really good thing to, you know, at least have verified to the degree

21:40 that you guys can.

21:41 Yeah.

21:41 Yeah.

21:41 You used to be with security, right?

21:43 It's, I remember sitting at a large computer manufacturing company here in central Austin,

21:48 central Texas.

21:49 I won't mention their name, but, you know, we're getting, oh, nice.

21:53 Thank you.

21:54 Yeah.

21:54 So we're, you know, launching a big release and we're all sitting in the go, no go meeting

21:59 and it's, you know, a couple of days before release.

22:01 And of course, then that's when the security team walks in.

22:04 Right.

22:05 And they're like, oh, you know, like literally like dropping down.

22:08 Hey, you didn't fill out your, your TPS reports.

22:11 And exactly.

22:11 Well, that's such the wrong time to do it because, you know, a lot of those ideas have to be built

22:16 in early and you've got to, yeah, it's really tricky to layer that on at the very, very end.

22:20 A hundred percent.

22:21 And now with containers, developers a lot more are closer to the operating system and worrying

22:26 about it.

22:27 You know, before you had your VM and you had, you know, you had ops folks taking care of that

22:32 was patching them and keeping it.

22:33 Here's my code.

22:34 It's going to need Nginx and micro whiskey.

22:35 You figure that out.

22:36 Go.

22:36 Right.

22:37 Yeah.

22:37 Now we're throwing it in containers and devs are doing a lot of that.

22:40 So shifting that security even farther left to, Hey, scan your images, make, you should

22:45 know what's going in your images.

22:46 You know, what base images you're using, those types of things are super important.

22:49 Yeah.

22:50 Okay.

22:50 And controlling that whole light, like you said, that, that whole life cycle, right.

22:53 Of, of when you're building your images and how through CICD, right.

22:57 Doing the consistency consistently, making sure you're doing scans.

23:00 Right.

23:00 So you can protect that whole pipeline.

23:02 A hundred percent.

23:03 Yeah.

23:03 We definitely need to be thinking about that as an industry.

23:06 It's serious.

23:06 Yeah.

23:07 There's so many smart people out there and they move fast.

23:10 They move really fast and keeping up with the hackers is hard.

23:13 That's for sure.

23:15 That's for sure.

23:16 So one of the things I thought it might be fun to touch on is just some of the areas

23:20 that containers are useful, maybe some of their, their benefits, things like that.

23:25 Right.

23:25 I think there's a lot of different use cases that are not, well, it makes DevOps more consistent

23:30 with development, even though that may be one of the benefits.

23:33 Yeah.

23:33 You know, the, the biggest problem that Docker solves is that packaging.

23:37 It runs on my machine.

23:38 Right.

23:38 And that's been part of our marketing since the beginning.

23:40 It works for me.

23:41 Right.

23:42 There's a fantastic thing that people should Google.

23:44 Maybe if I can find it, I've put it on the show before, but there's a thing called, it

23:48 works.

23:49 It works on my machine certification.

23:51 You can get the official certification.

23:55 This is done by Jeff Atwood and some folks.

23:58 Oh, that's fantastic.

23:58 And another guy over there.

23:59 And so you get this big banner.

24:00 It says, it works on my machine.

24:01 And the way you get it is you compile your code and getting the latest from any version

24:06 control, getting the recent from that is totally optional and up to you.

24:09 You launch the application that has been compiled.

24:11 You cause at least one code path to be the, to, that needs to be checked, to be executed.

24:16 The preferred way to do this is ad hoc manual testing.

24:19 You may omit this step.

24:21 If the code change was less than five lines or in the developer's professional opinion,

24:25 it couldn't possibly result there.

24:27 And then you check it into source control.

24:29 Right.

24:29 And so, yeah, I mean, that's, that's a joke.

24:31 And the reason I bring it up is it's just, you know, so common in the industry that you

24:36 run into this, this problem, right?

24:39 That, well, we tested over here and under this environment, it works fine, but in a different

24:43 environment, it doesn't.

24:44 And, you know, we try to backfill that with things like CICD and whatnot, but it's, you

24:48 know, it's still, it's not a perfect fit.

24:50 So with, with Docker, you can get much closer to running on exactly the same system.

24:55 Yeah.

24:55 Yeah.

24:56 The idea is not only package your app, but package the operating system, all of its

25:00 dependencies, your app, its configuration, all the application dependencies all in one package,

25:06 right?

25:06 Into an image.

25:07 And then pass, share that around, right?

25:09 Makes it so much easier.

25:10 Yeah.

25:10 At that large computer manufacturer, right?

25:12 We had two huge data centers.

25:14 And I talk about this in my getting started video, you know, 50 in each center just for

25:18 the browse layer and dub, dub, dub.

25:19 And if you go through and patching those machines, those 50, and you miss one.

25:23 And of course we had scripts and all that, but you know, we still had them manually.

25:27 You list of what servers are in and out of the, out of the data center, who's in DNS,

25:31 who's not right.

25:32 You miss one.

25:32 And then you get this, these, these random errors where I hit three good servers, the

25:36 fourth one breaks, and then you hit F5 and you go back to server two and you're fine.

25:40 Right.

25:40 Yeah.

25:40 That's really tricky when it's, it's going, you know, could be round Robin type of

25:45 load balancing.

25:46 And you're like, well, sometimes it's wrong, but I don't know when.

25:48 Right.

25:49 Yeah.

25:49 So we used to just go and, you know, restart all the servers one by one.

25:53 Some of the, some of the troubleshooting.

25:54 Yeah.

25:55 Some of the troubleshooting you get into is like, we have no idea.

25:57 Yeah.

25:58 So I think Docker really, really attacks that really well.

26:01 But then when you looking at developers, what I'm really excited is, you know, moving into

26:04 microservices and kind of more modern cloud first kind of development.

26:08 Right.

26:09 Again, getting everything running on your machine, you know, 10, 15, a hundred microservices that

26:14 you're not going to use.

26:15 You're not going to touch.

26:16 You don't work on, but they need to be there.

26:17 So, you know, you have this mesh of microservices or even just three or four of them, right.

26:22 That work together.

26:23 You have to have your sign on, you know, your single sign on, blah, blah, blah, all these

26:26 things and getting databases and queuing and everything running locally is hard.

26:31 Right.

26:31 If I got to install Mongo and SQL server locally, and then maybe projects are using two different

26:37 versions.

26:37 Right.

26:37 So now if everything's in containers and then if you're using compose, which I'll use orchestration

26:43 loosely here, but it orchestrates your containers locally.

26:46 Right.

26:46 Because Docker is all well and simple and easy.

26:49 When the goal is I need to fire up this Docker container and I put the thing I want to run

26:53 at the end, you know, I say Docker run, you know, container something.

26:58 But if I want to run multiple things and they've got to discover each other on the network, they've

27:03 got to have DNS names.

27:04 And this one has to start before that one.

27:06 Right.

27:07 All of a sudden it's a whole, a whole nother level of like manual challenges to do that

27:12 by hand.

27:12 So Docker compose is basically a way to write a file that takes a bunch of Docker containers

27:17 and starts them the right way with the right ports and everything.

27:21 Yeah.

27:21 Exactly.

27:21 Exactly.

27:22 Wire gives you kind of built in discoverability.

27:25 So DNS, you can easily plug in volumes and share volumes across your containers.

27:30 Yeah.

27:31 Super powerful.

27:32 And it's also a way to, like you said, writing out all these Docker run commands and then your,

27:36 you know, your run command is huge.

27:38 You can put that all into a compose file and then you use version control.

27:42 Things like that.

27:43 Yeah.

27:43 Yeah.

27:44 And then once I, yeah, exactly, Michael, I could set up and then, you know, setting up a

27:47 new dev.

27:48 Hey, you know, pull latest from GitHub and Docker compose up and, you know, brings your

27:53 application up.

27:54 I've got a couple of ideas here that I thought might be fun to bounce off you.

27:57 And the very first one on the list is onboarding new developers.

27:59 Yeah.

28:00 I mean, it's one thing to say, well, we're going to create a new project.

28:02 I want to work on it, but almost no one starts jobs with brand new projects.

28:06 They start jobs with, here's what we've been working on for four years.

28:09 It's kind of clunky, but it works.

28:11 Go.

28:12 Right.

28:13 A hundred percent.

28:14 A hundred percent.

28:14 And I wrote, I wrote a blog post about this, but, and then my mentees, right.

28:18 A lot of them come out of bootcamps and, you know, they're used to right click new

28:21 project.

28:22 Right.

28:22 And I'm like, that's not where you're going to go.

28:24 Right.

28:24 You're going to jump into a code base that is not the latest and greatest react, you know,

28:28 functional components, right.

28:30 You're going to have old stuff and you got to be productive.

28:32 It's a huge, I mean, I'm sure the audience will know.

28:34 It'd be great to hear, you know, the last time you joined a dev team, how long it took

28:38 you to just get your computer set up and get your environment set up and get familiar.

28:41 Right.

28:42 It's a week, at least a week, if not two weeks.

28:45 Or, you know, your machine dies and you're like, well, now I got to get it all set up

28:49 again.

28:49 I haven't done that for a year and a half.

28:50 So I forgot how to do that.

28:52 Right.

28:52 Yeah.

28:52 I'm trying to get everything into containers as much as possible, run everything in containers.

28:56 When you get into the GUI apps, it gets a little fun, but yeah, if you're running everything

29:01 in containers, it makes it super simple to be able to move those onboard new devs.

29:05 Yeah.

29:05 A hundred percent.

29:06 A hundred percent.

29:06 So another one of those that I think we kind of already touched on more or less is reliable

29:10 development.

29:11 Like everybody's working literally on the same system and you don't have the, you know, works

29:16 on my machine certification thing.

29:17 Yeah.

29:17 A hundred percent.

29:18 Another one though is, you know, I'm here on my Mac, but maybe I want to do things that

29:23 are as close as possible to where I deploy my various stuff things, which is Ubuntu, right?

29:31 And Mac is kind of like Ubuntu.

29:32 I mean, it's got sort of a Unix flavor to it, but it's not Ubuntu itself.

29:37 It's not exactly that.

29:38 Right.

29:38 And so having this ability to be closer to the environment that you're going to run at,

29:45 or you're going to deploy to, even though you happen to be developing in on something

29:48 that's not that.

29:49 Yeah.

29:49 Being able to get correct versions, right?

29:52 Of everything across your stack is, is very hard, right?

29:55 It seems simple, but it's not.

29:57 I mean, I could get Nginx.

29:59 I could brew install Nginx onto my machine, which I probably have done already, but maybe

30:03 I've got like the latest, greatest, whereas by default over on Ubuntu, if I just say, you

30:08 know, app install Nginx, I think it's held back a little ways for some reason, unless you

30:12 really like configure it for the latest sources.

30:14 And so, you know, maybe the configuration file has something new that I could do on my machine

30:19 that's supported.

30:19 But if I try to put it out there, it's just going to, you know, service failed to start.

30:23 Yeah.

30:23 Go find a log file somewhere and figure this out.

30:25 Right.

30:25 And that's, especially when you're new, it's like, I don't even know where the log files are.

30:28 Why is this happening to me?

30:30 It's so frustrating.

30:30 Right.

30:31 Right.

30:31 Yeah.

30:32 You're pulling down a project and the, the remia getting started is compile, right?

30:36 Make run, make, right?

30:38 Yeah.

30:38 And if unless you're a C, a Linux C developer and you start getting errors, you know, off the

30:43 stack overflow, you go and start randomly trying things.

30:46 Right.

30:47 And that as a senior developer, you know, I'm like, I'm so scared.

30:51 I'm a foobar my machine.

30:52 Right.

30:52 Cause I'm just changing settings and stuff.

30:55 And yeah.

30:55 Yeah.

30:55 But if you were doing that all inside of your container and really a Docker file is, is the

31:00 steps you would do to install an application.

31:02 Right.

31:03 And so they're all there repeatable, have the correct versions of, you know, libraries

31:07 all in the image.

31:08 Right.

31:08 I think it's a simple preconception to have is like Docker saves me from knowing Linux in

31:14 terms of the command.

31:14 So I don't need to know Linux if I'm going to run on Docker and maybe off to Kubernetes or

31:18 whatever.

31:18 And so I can just do Docker and then everything will be fine.

31:21 But in practice, like those steps you just described, those are apt install this, you know,

31:28 and the various configuration commands of Linux itself.

31:31 So there, you do need to know a little bit.

31:33 There's a very small subset that you need to do, but you know, you don't really have to be

31:37 an admin of Linux.

31:38 So I do think it takes down the bar, but I still think it's interesting that it's, you still

31:42 kind of have to know a little bit about how to set up the system.

31:44 Yeah.

31:44 Yeah.

31:45 And it's nice because you can start high level, like, Hey, I just run my, my, my

31:48 Mongo image and it works and I'm not exactly sure.

31:51 Right.

31:51 I just, here's the connection string.

31:52 We're good.

31:53 Yeah.

31:53 Here's the connection string.

31:54 And then if you start, okay, I want to build my own and I want to get slimmest images as

31:58 possible, right.

31:59 You're going to, you're going to start diving more in it.

32:01 And really the skillset to build your images is you have to understand Docker, but then

32:05 you also have to understand Linux commands, right?

32:07 How to install things on Linux, configure them for sure.

32:10 But you don't, to your point, right.

32:11 You don't have to start there.

32:12 Like don't become a super, you know, admin, you know, get the Linux command line Bible or whatever book it is.

32:19 Like start tearing through it.

32:21 Right.

32:21 I think that's a book.

32:22 Yeah.

32:22 I think it is too.

32:22 You can go very far with, without knowing that just basic Linux commands.

32:26 Yeah.

32:26 Yeah.

32:27 I got a few examples of like, these are the three things you really got to do.

32:29 Yeah.

32:30 And the nice thing too, about official images that you can, they're stored in GitHub too.

32:35 So if you go in the hub and see it, you can jump into the GitHub repo and actually read

32:39 the Docker file.

32:40 So it's great way to kind of, kind of learn, right.

32:42 Of best practices and those types of things.

32:45 Yeah.

32:45 Yeah, absolutely.

32:46 You talked about building like thin images and whatnot.

32:49 One of the interesting things is taking these Docker files and layering them, right?

32:54 Like instead of just saying, I'm going to, I'm going to need Nginx and I'm going to need

32:57 Python and I'm going to need all this.

32:58 So let's just build one that has all that.

33:00 And then any minor change you make to the Docker file means you completely rebuild all of that

33:06 stuff.

33:06 And maybe part of that's compiled from source that takes two minutes.

33:08 And it's like, why is this so slow?

33:10 Right.

33:10 Right.

33:10 You could make that four or five Docker files that one depends on the other that depends

33:14 on the other in very subtle, small ways.

33:17 So like only the very last bit that changes maybe really requires much work.

33:21 Right.

33:21 You want to speak to that a little?

33:22 Yeah.

33:22 So you can do two things in there.

33:23 I think you want to make sure one of the best practices you want to do is only one

33:27 run one process inside of a container.

33:30 And I'm going to, I'm going to, I use container and image sometimes interchangeably.

33:34 So, and then I get, I get yelled at for the people's on the internet.

33:38 I'm probably making it wrong.

33:39 So I'm an image, I believe.

33:41 Yeah.

33:41 No.

33:41 And you're totally fine.

33:42 Right.

33:42 Cause you can use them interchangeably, but so container is just a running image, right?

33:46 And if you're a computer scientist or object-oriented programmer, it's your class and your

33:51 objects, your class is your image.

33:53 And then your object is your container.

33:54 So containers are instance of running.

33:57 And I use them interchangeably all the time.

33:59 And I get yelled at in a lot of my talks, but, but generally speaking one process running

34:03 inside of your container, you know, it's the, it's the old Linux idea, separation concerns,

34:07 do one thing, do really well, microservices, those types of things.

34:10 But then to be able to create your images as small as possible, right?

34:13 You can do multi-stage builds is what we call it.

34:15 So you can have a stage in your Docker file.

34:19 That has all your compilers, your libraries, everything you need to build your application.

34:24 Make that one part of your Docker file.

34:27 And then below that you can reference that.

34:29 And so like a lot of Golang stuff, and we do this internally is we'll use Docker to build

34:34 all our apps, multi-architectural to architect.

34:36 And then below that, just pull out the compiled binary and put that in my image.

34:40 So now your image is extremely small.

34:42 It only has your executable in it and everything else that you compiler tools, GCC, all that

34:47 type of stuff is left out.

34:49 Oh, that's interesting.

34:49 Yeah.

34:50 So those are kind of like throwaway containers.

34:52 It'll do everything in container, get your nice dev build environment, build it, and then

34:56 pull only what you need out.

34:57 So even like in a node world where you're not, it's not a compiled, compiled language or Python's

35:02 compiled, not a compiled language, right?

35:04 You could do everything you need in an earlier stage and then pull that out.

35:07 Just what you need into the final stage to be able to serve those up in your runtime.

35:11 That's it.

35:11 And that's the best way to kind of get the smallest, lightest images you want.

35:16 And the smaller and lightest that you can get them, then they're easier to pass around.

35:21 They're easier to start.

35:22 They're faster to start up.

35:23 And the attack surface from a security perspective is very small.

35:27 Yeah.

35:28 Less is better there.

35:29 Less is better.

35:29 Yeah.

35:29 Absolutely.

35:30 All right.

35:30 Some other areas that I think two more that are certainly related, but not exactly the same.

35:36 I feel like the data science side has a lot to gain from the whole container stuff because

35:41 so often the environments are multi-technology.

35:45 You know, you might have, oh, we're going to use this library and it depends on Fortran.

35:49 We'll use this library and it depends on Rust.

35:51 And then we're going to control that from a Jupyter notebook.

35:53 And it's, you know, it's different environments make that harder, easier to set up.

35:57 And so I feel like data science has a lot to benefit from here as well.

36:01 I think so too.

36:02 And that's not my world day to day for sure.

36:05 And so I gave a talk at the Toronto machine learning group a while back.

36:09 The talk should be online.

36:10 So if you're interested, you'll be able to check that out.

36:11 And when I was step back and really thought about what I wanted to talk about and how is

36:15 Docker really helpful in these scenarios.

36:17 And it's kind of all the things we've been talking about.

36:19 It's how do I share my data set with other data scientists, right?

36:24 And you can put those in images and you can put those in volumes and share those, right?

36:28 And then how do I get a consistent environment to, you know, reproducibility is the biggest

36:34 thing in science, right?

36:35 Right.

36:35 That's the other half of that that I was hinting at.

36:37 That's right.

36:37 Yeah.

36:37 Yeah.

36:38 And so having that reproducibility that I can share with other scientists and you have everything

36:43 packaged together that I was running, right?

36:44 And you might swap out the data with your own data, but the processes is all the same.

36:48 So I think reproducibility is huge and talking with those folks, the machine learning folks,

36:53 that's what they were looking for, right?

36:55 Is how do I pass this around?

36:56 How do I share this?

36:57 How do I get my environment up quickly without having to become a full-blown computer scientist,

37:02 right?

37:02 A software engineer.

37:03 Or an admin or something.

37:04 An admin, yeah.

37:05 Well, one of the challenges in science in general, I believe lately is there's been,

37:09 what do you call it?

37:11 A crisis of reproducibility, but like a real focus on reproducibility.

37:14 And because of that, I think some folks have realized certain studies are very hard to

37:18 reproduce.

37:19 And it used to be what they would publish is, here's a graph I generated with my software

37:23 and here's the analysis of the graph.

37:24 And you're like, well, that could mean anything.

37:26 I can make a graph out of anything.

37:27 That doesn't mean very much, right?

37:29 And so then the move to like Jupyter Notebooks and IPython and so on to say, well, here's the

37:33 code and here's the graph and here's the explanation.

37:35 And that's a fantastic.

37:37 But what version of the library that maybe had a small interior change that no one sees

37:43 that might propagate some change down there.

37:46 And you can solidify all that stuff into a Docker container and then say, this is exactly

37:52 what we ran.

37:53 At least maybe it was wrong.

37:54 Maybe it was right.

37:55 But this is what we did.

37:56 Yeah.

37:56 Yeah.

37:57 Just even a minor tick in a version of an algorithm that's processing the data, right?

38:01 And I'm one tick behind you.

38:03 And well, that's not the same, right?

38:05 It's not the same.

38:06 Yeah.

38:06 It might be okay.

38:07 But we need to know that that's how the difference is.

38:09 Yeah.

38:09 You know, one thing that's interesting.

38:10 Have you seen this project Gigantum?

38:13 No, I haven't.

38:13 Okay.

38:14 So this one, I had these guys on the show back on episode 238 and it's really all about

38:19 Docker.

38:19 It's super interesting.

38:20 Oh, cool.

38:20 So it's like a collaborative way for building like local environments in Docker, but then

38:26 sharing those and then people can work on them and then you can like publish them to the

38:29 cloud.

38:29 And there's like all these cool activity streams.

38:31 And it's just all about orchestrating data science with facilitating that by doing Docker.

38:37 They have interesting things.

38:38 Like if you go in and open up like a terminal and you type some commands, I believe they try to

38:42 like capture those and make those part of what has to be done to the Docker container, even

38:46 though you didn't change the files.

38:47 They're trying to do a lot of stuff to make it like really the same.

38:50 So I don't know.

38:51 It's an interesting idea.

38:52 Oh, that's interesting.

38:53 I'm going to go check it out.

38:54 Yeah.

38:54 Jumping back to our earlier conversation, building that Docker file, right?

38:57 Is, is, and you, especially when you're learning commands, right?

39:00 That build debug cycle, test cycles can be painful a little bit.

39:04 Yeah.

39:04 So we're trying to think about that at Docker, right?

39:06 Like it's one thing to have an image and just run it and use it.

39:09 And then it's another to build, build an image, right?

39:11 A very complex image and kind of, so what you end up doing is kind of what you say.

39:15 You create a base image and then you're inside of that running commands and then go, crap.

39:19 Okay.

39:19 What did I run there?

39:20 Exactly.

39:21 You go write that down.

39:22 Yeah.

39:22 We kind of love to reverse sometimes.

39:24 That thing I just did to make this work, make that part of the Docker file, you know?

39:28 Right.

39:29 Extract what I did.

39:31 Those five things I typed on the command, the terminal command prompt.

39:35 When I logged in with Docker run, you know, Z shell or bash.

39:39 Yeah.

39:39 I need that too.

39:40 Yeah.

39:40 A hundred percent.

39:41 A hundred percent.

39:41 Yeah.

39:42 Advice.

39:42 Do you got advice on that?

39:43 I mean, it's basically a saving at each point right now.

39:47 It's very low fidelity, right?

39:48 You're, you're running the command and then, and trying to remember.

39:51 Right.

39:51 And it's painful.

39:52 Yeah.

39:53 Yeah.

39:53 It's very painful.

39:54 Some up arrow action.

39:55 Like, okay, I did that.

39:56 Then down arrow, down arrow.

39:57 Okay.

39:58 Those are the things.

39:58 Something like that.

39:59 Yeah.

39:59 Yeah.

40:00 Yeah.

40:00 We've been playing around with some interactive, lightweight kind of, I say editors, but tools,

40:05 right?

40:05 To, to build your images.

40:07 So the concept of building an image from scratch, it's where you kind of, you can do a top or a Docker file, say from, you know, Ubuntu or from Alpine.

40:15 Well, you can do from scratch and that's literally nothing.

40:18 Right.

40:18 And you're moving everything in yourself and that's tough, but it's, if you, the most secure and leanest image, that's the way to do it.

40:26 And yeah, so we've been thinking about tools around that and it's exactly that capturing what you're doing and what works.

40:31 Right.

40:31 So you can play a little bit and take, try and figure things out.

40:35 And then once you figure it out, you're like, oh crap, what, what was that sequence that just worked?

40:39 Right.

40:39 Cause I did five things, but those three things were what actually worked and that could be tough for sure.

40:44 I find that what I do is I'll fire.

40:47 I'll try to create the Docker file.

40:48 It'll invariably fail in some way that I didn't predict.

40:51 So then I'll get it as far as I can run it in an interactive mode and try to, you know, get it to go to where I want it and then go, okay, well, these are the steps.

41:00 And maybe it errored out during the build, but you couldn't figure out why.

41:03 So you want to go explore something to see what the log generated for that failure.

41:07 Right.

41:07 There's a little bit of back and forth.

41:08 Yes.

41:09 A hundred percent.

41:09 A hundred percent.

41:10 Yeah.

41:10 What do you think about things like attaching, basically using Docker within some of these tools like PyCharm and VS Code both have these ways to say, just run this, but in Docker when I pressed debug.

41:23 Yeah.

41:23 My old school developer, you know, no fancy editors, right?

41:29 Text editor, you know, it dies a little bit inside, but I've had to get over that.

41:33 Right.

41:33 I'm like, no, do these, right?

41:35 Like I tell my mentees too.

41:37 I'm like, okay, when we start, like you're in a text editor, remove all, remove all the tools.

41:41 Cause you've got to feel the pain to understand what helps.

41:44 Yeah.

41:44 Yeah.

41:45 Sure.

41:45 But with that said, right.

41:46 Yeah.

41:47 I mean, the tools are fantastic, right?

41:49 The context switching, right?

41:50 If you can stay right in your ID, your main tool and do everything within there and do it really well is super powerful.

41:56 The VS Code plugin is super powerful, right?

41:59 Of managing your containers, running containers, dev containers, connecting into ACI and Azure and launching your containers right there.

42:06 It's extremely powerful.

42:08 Yeah.

42:08 Yeah.

42:08 I feel like it's going to get to the point where you might be running stuff in Docker, but you don't even know it.

42:12 Yeah.

42:12 You might conceptually know, but there's nothing about what you do or what you see that makes you feel like, oh, it's running in Docker.

42:18 You just, I pressed run.

42:19 It did these things.

42:21 I saw it in my browser or I saw the output.

42:23 Yeah.

42:23 I don't know where that happened.

42:24 Right.

42:24 But it happened in Docker.

42:25 Exactly.

42:26 Yeah.

42:26 It just works.

42:27 Right.

42:27 Yeah.

42:27 That's where we're trying to go is like with our tools is like you, the more, you know, you're, they get out of the way, right?

42:33 They're not in your way is maybe the best way to say it.

42:35 Yeah.

42:35 Really good tools.

42:37 You kind of, you kind of go, does that really doing a lot for me?

42:40 And then when you figure it, you're like, oh yeah, it's doing a ton.

42:42 I just didn't, don't know it.

42:43 It does it so well.

42:45 Right.

42:45 Exactly.

42:45 I think we have time for a few more topics that we can touch on.

42:49 So we talked about the multi-container stuff and we talked about, you know, run this on my cloud.

42:54 And I feel like a lot of times what that means these days is Kubernetes, right?

42:58 Everybody seems to have a hosted Kubernetes offering.

43:01 Sometimes that means just give us your container.

43:03 Others that means, well, we'll really just run the cluster sort of configure it for you, but you kind of got to still own those VMs that run it.

43:10 There's some sort of spectrum there.

43:11 What are your thoughts on people working with Kubernetes versus just directly with Docker itself or maybe even a pass, like almost a serverless type thing?

43:20 If you spend a lot of time on the internet, right?

43:22 We're all on the bleeding edge, right?

43:24 Yeah, we absolutely are.

43:25 Yeah.

43:26 You read a lot of blog posts about Kubernetes and service meshes and serverless.

43:31 And those are all fantastic and wonderful, right?

43:33 But a lot of us out there are not, we're not the Googles or the Netflix or, you know, Disney Plus, right?

43:39 You can see I watch a lot of movies.

43:40 But anyways, you know, so you have small teams, small three, five person teams that really are writing the majority of the software out there, right?

43:49 And there's nothing wrong with standing a VM up, putting a Docker engine in it and running your containers like that, right?

43:55 That's the way we started.

43:56 It's extremely powerful.

43:58 You know, before I came to Docker, I had a consulting business, a custom dev.

44:02 And that's how we ran all of our containers, right?

44:05 We had a Docker engine installed on a VM, sometimes two VMs, right?

44:08 That we managed as the orchestrator.

44:10 And it ran fantastic.

44:12 And we could scale, we had load, right?

44:14 And to update it and to maintain it, all the things we've kind of been talking about today were super simple because the only prerequisite for the VM was to have the engine installed.

44:24 Yeah.

44:24 And to be honest, that's how my stuff is running now.

44:26 I have a CI, CD stuff set up.

44:28 So I do get pushed to a certain branch.

44:30 My VMs automatically work with the load balancer.

44:33 They automatically update themselves.

44:35 They restart and like it's hands off, right?

44:38 And, you know, the small, small set of us, like it works.

44:41 Yeah.

44:42 A hundred percent.

44:43 A hundred percent.

44:43 And serverless.

44:45 And then also kind of the container passes that are out there.

44:48 So ECS, ACI.

44:50 So ECS is Elastic Container Service from Amazon.

44:54 ACI is Azure Container Instances.

44:56 And I don't know if Google has one.

44:58 They probably do too.

44:59 Yeah.

44:59 Love you, Google.

45:00 But yeah.

45:02 Anyways, you know, it's being able to take your container and just run it in the cloud and worry about the container running and what it needs to do and how it needs to run, right?

45:09 And ECS will take care of the rest underneath the covers.

45:13 That's a fantastic option.

45:15 I mean, it's kind of, you know, it's like those progressions, right?

45:18 If you're doing a single VM with the Docker engine or two of them, a couple of them, and that becomes painful when you need to scale, really look at ECS or ACI, right?

45:26 Because that will help you scale a lot easier.

45:28 And you don't need to be a Kubernetes expert.

45:30 And then if you do, then go to Kubernetes.

45:32 But I always tell people, and Swarm is a great option too.

45:35 Swarm is an incredible orchestrator.

45:37 It works.

45:38 How does that compare to Kubernetes?

45:40 You know, I hear Docker Compose.

45:42 I hear Swarm.

45:42 I hear Kubernetes.

45:43 I'm not sure when I should be thinking about which.

45:46 So Compose is fantastic for local development.

45:48 I would use it primarily there.

45:50 You can use Compose to deploy and production.

45:52 Would I use Compose if I had only a single container I wanted to run?

45:57 But maybe it had a complicated layering, potentially?

46:00 Yeah.

46:00 So Compose works great there too.

46:02 Even if you're running one container and all the command line switches and flags and environment variables and secrets, all those type of things, like put them all in your Compose file.

46:11 So one, you don't have to remember all of them.

46:14 And two, you don't write bash scripts to just run the Docker command, right?

46:19 Yeah, you plug them all in just like that.

46:21 You can see you're passing ports, volumes, all those type of things, right?

46:25 You know, and I tell people start, think about Swarm, right?

46:27 If you're doing one instance, don't jump to, like have really good reasons to jump into Kubernetes.

46:32 It's super powerful.

46:34 It's a great tool.

46:35 It really is, but it comes with a ton of complexity, right?

46:38 So if you don't need to go.

46:39 Well, there's, like I said before, there's a difference between I want to run this on Kubernetes and I want to have my own Kubernetes cluster for which I'm the admin.

46:46 Right.

46:46 Right.

46:46 Yeah.

46:47 And don't get stuck in.

46:48 Also another advice.

46:49 And some engineers, you're like, don't get focused on developing for your resume, right?

46:53 A lot of times, oh, we got to get in Kubernetes.

46:55 I want to have Kubernetes.

46:55 I've done all this, right?

46:56 And yeah, you know, you want to learn new technology and stay cutting edge.

47:00 But that's a tough one.

47:02 That's a tough one to go to.

47:03 Yeah.

47:04 You can get very far with single engines, with Compose, and then with Swarm.

47:09 And Swarm is a great orchestrator.

47:10 It's built into the engine.

47:12 It moved to the enterprise with Mirantis when they bought the Docker Enterprise business.

47:17 So they maintain it.

47:18 We got out of Docker proper.

47:19 It's gotten out of the orchestration business.

47:21 But it's a fantastic orchestrator.

47:23 It just works.

47:24 A prior life at Docker, I ran all the customer success technology.

47:27 So our knowledge base, our search engine, our training tools and everything.

47:31 And we ran on Compose.

47:32 Compose and Swarm.

47:34 All on Swarm.

47:35 Five, nine uptime.

47:36 Never touched it.

47:37 Didn't have a DevOps team, right?

47:38 It just, it really works.

47:39 When you need things like sidecars and more complex networking and the more complex data storage,

47:46 volumes, those type of things, that's where Kubernetes really shines.

47:50 But other than that, Swarm is fantastic and single engines will get you very far.

47:55 And then, like you said, I would go to EKS or something like that first, right?

47:59 Have a Kubernetes cluster and manage at the level that you need to manage at and nothing lower,

48:03 right?

48:04 Until you have to.

48:05 Makes sense.

48:05 Chris McDonough, creator of the creators of Pyramid.

48:08 Framework out there is in the live stream.

48:10 It says, Compose kind of fills the same space as Buildout did in Python land for managing one

48:14 or multiple containers locally.

48:15 Yeah, awesome.

48:16 Hello, Chris.

48:17 Thanks for being here.

48:17 Hey, Chris.

48:18 Yeah, very cool.

48:18 So the last thing that I want to touch on, the last topic I think we have time to talk

48:23 about is the future.

48:24 Where are things going with Docker, right?

48:27 Like we've seen this move to focusing more on, you said, shift the left, more on the developer

48:31 tools and whatnot.

48:32 I'm glad you brought it to roadmap.

48:33 Thank you.

48:34 My bosses will be happy.

48:35 My masters.

48:38 Anyways, love you, Matt.

48:40 So GitHub out there for forward slash Docker forward slash roadmap.

48:45 That is our public roadmap.

48:47 That is our roadmap, right?

48:48 We work on that roadmap.

48:49 We're actually coming out with a blog post with a feature.

48:51 And that was spawned, came out of the roadmap, right?

48:54 It was an idea from the community.

48:56 It's integrating in with different terminals with Docker desktop.

48:59 And that came out of the community.

49:01 And people said, hey, I run iTerm on my Mac.

49:05 And so does 99% of the other developers on Mac.

49:08 We want that integrated, our integrated desktop.

49:11 And so the upticks were really great.

49:13 Anyways, we implemented it.

49:14 So you'll see Ben, if you're looking at the screen on the right, Ben is the best PM I've

49:20 ever worked with.

49:21 Seriously, he's fantastic.

49:22 But he is in there constantly.

49:23 Yeah.

49:24 So we look at this roadmap.

49:25 We follow this roadmap.

49:26 We build off of this roadmap.

49:28 We don't have a secret shadow internal roadmap, right?

49:30 And we say, hey, yeah.

49:32 You've got different channels for like Windows and Microsoft and the engine and all that stuff,

49:36 right?

49:36 Yep.

49:37 And so go read through there.

49:39 Put in an issue if you have one.

49:41 If you don't find it, it's where you can interact, add comments, those type of things.

49:44 We do use that constantly.

49:46 You know, I don't.

49:47 So we have DockerCon coming up.

49:49 So I don't want to give any secrets away.

49:50 But yeah, we have, I would say, look for us in this year, the past year, we really kind

49:55 of solidified the business, right?

49:56 Really did a lot of things that Docker didn't do early in its early days, right?

50:02 As a business wise, you know, we're shifting around a lot, but focus back on Hub and say,

50:06 hey, you know, let's tighten up Hub.

50:08 This is a place where a massive amount of developers come for value.

50:11 So we tightened it up, put in good features like audit logging and more team features and

50:16 fixed our plans and seats and how the pricing and how that works.

50:20 And then started moving towards developer tools.

50:22 So integrating it with ECS, ACI into the public clouds.

50:26 You'll see a lot more of that coming.

50:28 See a lot more tools around local development, container first development, a lot of sharing.

50:33 So it'd be interesting to say, I'm working on a feature.

50:36 I have a branch and I want to share that with you, Michael.

50:39 Hey, you know, take a look at this real quick.

50:40 And now you're in that same scenario, right?

50:42 I have to check out your branch.

50:43 If I'm doing everything on my machine, do I have all the versions correct?

50:46 Do I have everything right?

50:47 Well, what if you could just wrap that all up a container and I just share it with you?

50:50 And you fire that container up and you're in a dev environment and it not just running

50:54 the container, but able to see my code and everything and the app running inside the container and

50:59 interact with it, right?

51:00 Yeah, that's cool.

51:00 That's powerful.

51:01 That sounds a little bit like the VS Code feature where they have that's like launch this in

51:06 code off of GitHub.

51:07 Yep.

51:07 And it just like sets up that remote environment.

51:09 Exactly.

51:10 Exactly.

51:11 Yep.

51:11 Launch, launch this for me.

51:13 And also too, I can notify you, right?

51:15 So you get in a little desktop notify.

51:17 Hey, you got something shared with you and you launch this in VS Code and it brings it all

51:21 in for you.

51:22 Yeah, cool.

51:22 And to your earlier point, you go, oh, if you didn't know you're running containers, you

51:26 might not know it.

51:27 Right.

51:27 It's like, oh, I just got this PR shared with me and I want to check it out.

51:31 Right.

51:31 And it's just the run button and it's good.

51:33 I push the run button.

51:34 Yeah.

51:34 Yeah.

51:35 Awesome.

51:35 A lot of stuff coming around that.

51:36 A lot of more features in for teams and sharing features coming in Hub.

51:40 We have scanning and the security scanning in there now.

51:42 Yeah.

51:43 A lot of interesting.

51:43 One thing that GitHub added was notifications of security CVEs and whatnot.

51:50 Like periodically I'll log in and I did this class that interacted in a very minor way

51:54 with an Electron JS app.

51:56 And it's always like your repository has this critical vulnerability because some random

52:01 version in a package lock dot JSON is, you know, like, so for me, I'm like, I don't really

52:07 need that, but I'll go ahead and just accept it because I just need it to be quiet to me.

52:11 But in general, those features are super useful when those come up for your actual code.

52:15 Anything like that you guys are thinking about?

52:17 So we partnered with Snyk, which is a dev security scanning company, security company.

52:23 I shouldn't say just scanning because they do a bunch of stuff.

52:25 But now you have Docker space scan.

52:27 So you can scan your images locally, get reports, see high, low severity.

52:31 Yeah.

52:31 And then that'll run in Hub.

52:33 So when you push into Hub, your images will be scanned if you have it turned on.

52:37 And so you have a central place where you can see all those.

52:39 And then you can use Snyk to remediate them and those types of stuff.

52:43 And Snyk has really good tools.

52:44 Right.

52:45 Because maybe you could have scanned locally, push your stuff to production.

52:49 Right.

52:49 And then you haven't touched it for three weeks.

52:51 Right.

52:51 But in the meantime, something's come out you need to take action on.

52:54 Right.

52:54 And so having it on the Hub, giving you notifications is constantly running.

52:58 Right.

52:59 Exactly.

52:59 Exactly.

53:00 Yeah.

53:00 Being able to get notified of your base images.

53:02 Right.

53:03 So if you run in the node or the Python base image.

53:06 Right.

53:07 When that changes underneath you.

53:09 Right.

53:09 And there's security vulnerabilities introduced.

53:11 Do you want to know?

53:11 Right.

53:12 Should I go to the next version or not?

53:14 And then I think, too, to your earlier point of, you know, it's like I'm not a security professional.

53:18 Right.

53:19 So I see these reports and I do a scan and I go, oh, heck, you know, 300, you know, high

53:24 severity vulnerabilities.

53:25 Right.

53:25 What do I do?

53:25 And I think what we're trying to do is say, hey, here's how you remediate that.

53:29 Right.

53:29 You're on version 3.2.

53:31 If you bump up to 3.3, it fixes these.

53:34 So you should do that.

53:35 Right.

53:35 A little minor version upgrade or major upgrade takes you to instead of 300.

53:40 Now you have 20 vulnerabilities.

53:41 Right.

53:42 And they're all medium.

53:43 So.

53:43 Yeah.

53:44 You know, I think we need that as engineers to be able to get our job done quicker writing

53:47 code.

53:47 You know, it's a primary function.

53:49 Right.

53:49 So I got a bunch of these vulnerabilities.

53:50 And to your point, you kind of like just, yes, just clearly these red X is off of here.

53:54 Right.

53:55 We might not know exactly what's going on.

53:56 So really trying to help you remediate those vulnerabilities, but also understand why and

54:00 what you're doing.

54:01 Right.

54:01 Yeah.

54:01 That sounds really valuable.

54:02 We got it for our code.

54:04 We should have it for basically our infrastructure.

54:05 Comment from the live stream.

54:07 Could Docker potentially be able to share really big files across the globe, allowing others to recode

54:12 easily?

54:13 How would this work?

54:14 Honestly, I don't know.

54:15 I mean, it certainly will allow you to share files as images and it will definitely allow

54:19 you to have environments set up like data science environments that could analyze those.

54:23 But what are your thoughts?

54:25 I think we could do some of that now.

54:26 So I'm through hub being able to just Docker push and Docker pull is very powerful.

54:30 Right.

54:31 You can get a whole disk image, let's say.

54:33 Right.

54:33 Right.

54:33 Because instead of getting just the Docker file, you got to build, you get the result, which

54:36 could have had files copied in locally and all set up in the file system internally.

54:40 Right.

54:40 Yeah.

54:40 Yeah.

54:41 Yeah.

54:41 So two ways to share with just the Docker file and say, hey, build this yourself or I've

54:45 built it.

54:46 Here you go.

54:46 Right.

54:47 Yeah.

54:48 I would love to hear, you know, reach out to me on Twitter or something.

54:51 Right.

54:51 And let me know.

54:52 I'd love to hear more of what you're trying to do.

54:53 And because that sounds interesting.

54:54 Right.

54:55 Yeah.

54:55 Bandwidth is interesting too around the world.

54:57 Right.

54:58 So, you know, I sit here in Austin where, you know, high speed internet.

55:01 Well, really the rest of the world doesn't have that.

55:03 Right.

55:04 So low bandwidth.

55:05 And, you know, of course I got a screaming desktop laptop.

55:08 Right.

55:08 That I use in fast and not, you know, the whole world doesn't have those advantages.

55:13 So, you know, and if I'm pulling down a Mongo, some image, right.

55:16 And I'm picking on Mongo all the time, but you know, if it's, if it's over a gig, that's,

55:20 that's big, right.

55:20 That it'll take a while on some network.

55:22 So yeah.

55:23 Yeah.

55:23 All the video and video courses and audio processing and file exchange.

55:28 I've had to buy unlimited data from Comcast because I was going over my 1.2 terabyte per

55:34 month data caps every month.

55:36 That was ridiculous.

55:36 Yeah.

55:37 Yeah.

55:37 So a lot, a lot of data these days.

55:38 All right.

55:39 Well, you know, fantastic stuff you guys have coming up there.

55:41 I guess maybe we should probably wrap it up just for the sake of time, but yeah, I guess

55:45 we'll, we'll hit the, the two final questions I always ask.

55:49 First of all, notable PyPI package.

55:51 This is like something interesting that you ran across.

55:54 Maybe you want to just share people that find useful, some Python library.

55:57 I love testing.

55:58 So test containers.python.

56:00 That's a little inside joke that no one on here really knows, but I have, I have developer

56:04 friends.

56:04 So I will, one of my favorite things to argue against is testing just as a thought experiment,

56:09 but it's, it's really fun.

56:10 Right.

56:10 But anyways, but don't listen to me.

56:13 Testing is super important.

56:14 Right.

56:14 And being able to test in containers and pick off these prebuilt containers and use right

56:19 in your, in your app, right in your code is super powerful, extremely powerful.

56:23 So definitely interested in test containers.

56:25 Yeah.

56:25 It's super cool.

56:25 It lets you basically create a with block that says with my SQL container as my SQL or with

56:31 my MongoDB and DB container as that.

56:33 And it just fires up a Docker container.

56:35 You do your tests within that thing and maybe use a high test fixture to preload the test

56:41 data, then run your code against it.

56:42 So instead of mocking out the database and mocking out Redis, you just run a test Redis

56:47 and then throw it away, which I think that's fantastic.

56:49 It's like hybrid between integration tests and unit tests, isolation type stuff.

56:54 It goes back to our earlier conversations around reproducibility, right?

56:57 Yeah.

56:58 Having same environments are very important, right?

57:00 Yeah, absolutely.

57:00 And then final question, if you're going to write some code, what editor do you use these

57:04 days?

57:04 If you would have asked me that about two years ago, it would have been Sublime.

57:07 Been in a plain text editor, you know, back and forth, alt tabbing and back and forth

57:11 between my terminal.

57:12 But now I've fallen in love with VS Code.

57:14 Yeah.

57:14 It's extremely powerful.

57:15 So I feel like Sublime, like so many of the people who love Sublime have just naturally

57:19 moved to VS Code.

57:21 I mean, Sublime was really cool.

57:22 It just had all these like weird community stuff.

57:24 Like there was Sublime and then Sublime 3 and there was like permanently in beta and like,

57:28 are these getting updated?

57:29 Which one is like the real thing?

57:30 It's just, it was always kind of a little unclear where it was going.

57:34 And then, you know, VS Code came along with a similar model and just said, well, why don't

57:38 we put a hundred people just like constantly adding features to this?

57:40 Yeah, exactly.

57:41 I don't know what the number is, but it's high.

57:42 Yeah.

57:43 And it's interesting you say that because I was a long time Sublime.

57:46 I bought it, right?

57:47 And purchased it forever.

57:48 And yeah, it was like two or three and I have a theme over here, but it doesn't work in three.

57:52 And how do you get it?

57:53 It was just weird.

57:54 And then VS Code just kind of snuck in and I said, yeah, I'm going to use it.

57:57 I'm going to use it.

57:57 And now I keep just using, I use it as a text editor back then, right?

58:01 And now I just keep using more and more features, plugins.

58:03 I mean, the ecosystem around that is so powerful.

58:06 There's neat stuff.

58:07 And especially there's a lot of neat Docker things going on in it.

58:09 Yeah.

58:09 I'm going to run my VS Code in a Docker and then run, you know, dev containers.

58:13 And it'll be like Inception.

58:16 It'll be Docker.

58:16 Yeah, a little Inception.

58:17 Docker VS Code all the way down.

58:18 All right.

58:19 You got a moment for a couple more audience questions before we wrap it up?

58:22 Absolutely.

58:23 You know me.

58:24 I'll chat away for days, but I know your audience might get bored.

58:27 All right.

58:28 So Brian Sands out there.

58:30 Hey, Brian says, do you know of any good examples using Docker Compose with Postgres for persistent

58:35 local storage?

58:36 I have a hard time finding up-to-date working info to do this properly.

58:39 Yeah.

58:39 Check out Awesome Compose.

58:41 So it's a GitHub repo.

58:43 Docker owns it.

58:44 So Awesome-Compose.

58:46 I can't remember if it was under the Docker organization or not, but there's a ton of different

58:51 kind of configurations with different stacks.

58:53 That's super interesting.

58:54 I had no idea about this.

58:55 Good question, Brian.

58:56 Yeah.

58:56 Thank you, Brian.

58:57 I paid him.

58:58 I'll send you that.

58:59 I'll Venmo you here in a minute.

59:00 No, but yeah, check that out.

59:01 If you can't get your specific stack, you're going to get something very close, right?

59:05 So there's Flask in there.

59:07 There's Nginx like Flask and Postgres, different kind of three-tiered stacks.

59:13 And then within that, you'll have Docker files.

59:15 And then you'll have a Compose file to kind of bring it all together.

59:18 And you should get some really great examples in there.

59:20 If not, please do hit me up on Twitter and I'll get you pointed in the right direction

59:23 for sure.

59:24 Yeah, very cool.

59:25 Awesome.

59:25 And then Tino asks, what is the current state of Windows-based Docker containers?

59:30 I know there's Nanostrip.

59:31 I got to tread lightly on this one.

59:32 You know, I was super excited when Microsoft, when we started supporting it for Windows containers.

59:37 You know, the focus has been not as much.

59:40 The amount of people actually using Windows containers is very, very small compared to Unix-based

59:46 containers.

59:47 So, you know, just because of that, the focus has not been on that.

59:50 There's still a thing.

59:51 They're still being developed on.

59:53 They're just not as prominent in the industry for whatever reason, especially with .NET.

59:56 Well, you know where I would say they probably, as is standard with Microsoft these days,

01:00:01 their focus seems to be if it runs on Azure, we love it, right?

01:00:06 This is where we will sacrifice many, many of the things so that it will run on Azure.

01:00:11 And a lot of that, I believe, is check this thing in Windows and like say Visual Studio

01:00:15 Code so I can push deploy to run on Docker on Azure.

01:00:18 Yep.

01:00:19 I think that's probably where a lot of it is.

01:00:21 Yeah.

01:00:21 And WSL2 is huge, right?

01:00:24 So talking to the Microsoft folks, right?

01:00:25 They want to be the place where you come.

01:00:28 The Windows platform is the place you come for developing, right?

01:00:31 So whether you're a Windows developer or Linux developer, right?

01:00:33 You're using VS Code.

01:00:34 You're running on Windows.

01:00:35 You're using WSL2 for Unix development or you're using Windows for Windows development.

01:00:40 That's their thought, right?

01:00:41 So the underlying platforms kind of change and with containers, they can do some of that.

01:00:45 So they're focusing a lot on WSL2, which is super powerful.

01:00:49 Right.

01:00:49 Which really just means make WSL2 good so that it runs on Ubuntu or something like that,

01:00:53 right?

01:00:53 I mean, we just leverage that Ubuntu Docker support, I suspect.

01:00:56 Yeah.

01:00:56 While we're talking platforms, I've been doing basically nothing but M1 stuff these

01:01:01 days.

01:01:02 Since mid-December, I thought I would, you know, I got my Mac mini M1 and I thought I'd be juggling

01:01:07 this would work here, that would work there.

01:01:08 And I just literally have just turned off my laptop and just do this.

01:01:12 And I love it.

01:01:12 What's the story of Docker and M1?

01:01:14 Yeah.

01:01:15 So we love Apple.

01:01:16 It was nice to see our little, I don't know if you saw an Apple's keynote, you know,

01:01:20 where you saw the Docker desktop on there, which was super cool.

01:01:22 We're getting very, very close to shipping, you know, a release.

01:01:26 Okay.

01:01:27 A GA.

01:01:27 Yeah.

01:01:28 I mean, really close.

01:01:29 I don't want to give a date or anything, but really close.

01:01:32 But you know, tomorrow?

01:01:32 Yeah.

01:01:33 Tomorrow will be okay.

01:01:33 We'll do that.

01:01:34 I'll take it.

01:01:35 Very, very close.

01:01:35 They're working on it.

01:01:36 It's one of our primary feature sets to finish, to get done, right?

01:01:40 And again, it came from the community.

01:01:42 It was our number one issue, right?

01:01:44 When the M1s dropped, you know, I think everybody jumped into our GitHub issue and said, we need

01:01:48 support.

01:01:48 I think this whole M1 stuff has come out way stronger than I expected.

01:01:52 I thought, oh, that'll be kind of a neat, who knows what they're doing.

01:01:54 But like, as it came out, it's like, wow, this is really transformative in some ways.

01:01:57 Yeah.

01:01:57 You can get the tech preview.

01:01:59 It's pretty stable right now.

01:02:00 You know, it's just going to be on probably, you know, one-off little issues on your environment,

01:02:05 how you run containers and what exactly, what container, you know, because they got to be

01:02:10 compiled for the different lines.

01:02:11 It's got to basically be an ARM image.

01:02:12 Yeah.

01:02:13 Yeah.

01:02:13 And sometimes you run ARM, but then, you know, Mongo doesn't have an ARM version yet.

01:02:17 So you're running an emulation and, you know, so there's those type of things.

01:02:20 We're very, very close to releasing GA.

01:02:23 Stay tuned.

01:02:24 Next couple of weeks, I would say.

01:02:25 Yeah.

01:02:25 Fantastic.

01:02:25 And shout out to the MongoDB people.

01:02:27 Where's your M1 version?

01:02:27 Come on.

01:02:28 All right.

01:02:28 Final question.

01:02:29 We're going to wrap it up.

01:02:30 Ricardo says, networking on Docker feels like it's easier with LXC, one of the other container

01:02:36 styles.

01:02:37 Am I doing something wrong?

01:02:39 I'm interested in giving a container-in-zone IP address.

01:02:41 Peter, this is you.

01:02:42 I have no idea.

01:02:42 Yeah.

01:02:43 Ricardo, I thought I was going to get out of here without any networking questions.

01:02:46 But Ricardo, you are not alone.

01:02:48 Networking in containers is difficult, right?

01:02:50 You got to deal with different networking technologies, even locally.

01:02:54 So yeah, it's not easy.

01:02:56 Is this easier in something like Swarm or Kubernetes or something else that maybe controls them more?

01:03:00 No, it gets even more complicated.

01:03:02 Okay.

01:03:02 Yeah.

01:03:04 Once you step outside of, if you have cloud-native apps, right?

01:03:07 And I'm not a huge fan of that term because what the heck does that mean?

01:03:11 But if you don't-

01:03:12 I want to permanently pay to run my app forever.

01:03:14 Thank you.

01:03:15 Yeah, exactly.

01:03:17 But yeah.

01:03:18 So if you're in microservices, you're using configuration outside of your app to control

01:03:23 your app, right?

01:03:23 Is the best.

01:03:24 But I see a lot of legacy apps.

01:03:25 I'll do legacy in double quotes also, right?

01:03:28 Because just meaning not more microservice type apps, right?

01:03:32 And so you're trying to run those apps inside of containers and they have unique networking

01:03:36 needs, unique volume needs, right?

01:03:38 They're still writing to disk and reading from disk and you can't control that without changing

01:03:42 code or they have IP addresses or subnets kind of hardwired in, right?

01:03:47 And you can't do a lot of that.

01:03:48 So you got to configure your networking around your app with inside a container and that's where

01:03:52 the complexity comes in.

01:03:54 So in this scenario, giving your container its own IP address, it's a little bit against

01:04:00 best practices, right?

01:04:02 So containers should be ephemeral.

01:04:03 They should go away, right?

01:04:05 You should think of them.

01:04:05 And I got to get a better analogy.

01:04:07 My apologies to anybody if this offends you, but we used to think of our VMs as pets, right?

01:04:12 And we take care of them, keep them up and love them and hope they live forever, right?

01:04:17 Configure them.

01:04:18 And then now you have containers, which are more like, let's say, I used to say cattle, but

01:04:22 I'm more that offends people.

01:04:24 So let's say consumable foods, right?

01:04:26 You know, like you get-

01:04:28 Fungible elements.

01:04:29 Yeah.

01:04:29 So you get more like a cake, right?

01:04:32 If I get cake in my house, I'm eating that, right?

01:04:34 And it's gone.

01:04:35 And then if I want new cake, I got to put new cake, right?

01:04:37 So same with containers.

01:04:37 It goes bad.

01:04:38 You don't try to rehabilitate it.

01:04:39 You just get new cake.

01:04:40 Right, right.

01:04:40 Yeah.

01:04:41 But you don't eat half the cake and then bake, you know, put another bake the half.

01:04:44 This analogy is going poor, but-

01:04:46 Speak for yourself.

01:04:47 We refill our cake.

01:04:48 We don't ever want to go down to zero cake.

01:04:50 Right.

01:04:51 But that's the idea.

01:04:51 So if you're assigning an IP to a container, that container goes away, right?

01:04:55 And the idea is if I'm orchestrating that I have multiple containers all running, they

01:04:58 shouldn't have the same IP, right?

01:05:00 If one goes away, one comes back up, you don't want to, you know, so those are the type of

01:05:04 things you're getting into.

01:05:05 And Ricardo, you're probably shaking your head going, yes, but, but, but, but, but, and I

01:05:09 totally-

01:05:10 But I need it.

01:05:10 Yeah.

01:05:11 I totally understand.

01:05:11 And you can do it, but it's just a little more complex.

01:05:14 Yeah.

01:05:14 A little hard to answer on, you know, with a couple of minutes here, but-

01:05:17 Yeah.

01:05:17 I hit you up on Twitter.

01:05:18 All right.

01:05:19 So thank you so much for being here, Peter.

01:05:21 It's super interesting.

01:05:21 Final call to action.

01:05:22 People want to get started maybe making Docker more of their life.

01:05:25 What do they do?

01:05:26 Definitely go hit me up on Twitter.

01:05:27 Say hello.

01:05:28 Love to talk to folks.

01:05:29 Join our community.

01:05:31 Jump into community Slack.

01:05:32 If you're, questions like that, Ricardo, the community's there.

01:05:35 They'll be very, very helpful.

01:05:36 A lot of our engineers, our developers are in there.

01:05:39 All of our PMs are in there.

01:05:40 Ton of captains are in there.

01:05:41 Docker captains are in there.

01:05:42 And they're very, very helpful.

01:05:44 So this is a great way to get plugged into the community.

01:05:46 And then the last thing is DockerCon is coming up here in the May.

01:05:49 Sign up for DockerCon.

01:05:50 It's going to be an online live event.

01:05:52 Last year, we had 80,000 registrants, a really, really big show.

01:05:56 So you're not going to want to miss a great content coming.

01:05:59 You get to see more of my smiley face.

01:06:01 And then CFP is still open.

01:06:03 We're getting ready to close it on the 15th.

01:06:05 So if you ever thought about giving a talk, right?

01:06:07 Please submit.

01:06:08 If you're a first-time speaker, don't let that deter you, right?

01:06:11 DockerCon is traditionally a pretty big conference and well-attended, right?

01:06:15 And it might, you know, first-time speakers might not submit.

01:06:18 Please do.

01:06:18 We do read all of them.

01:06:20 And we do take an account, you know, what you've done in the past.

01:06:22 But we also do look for new speakers, right?

01:06:24 A hundred percent.

01:06:25 Don't let that deter you, for sure.

01:06:27 All right.

01:06:27 Fantastic.

01:06:28 Well, thanks for taking the time, Peter.

01:06:29 It's been great to chat with you about this.

01:06:30 Yeah.

01:06:31 Hey, thanks for having me on.

01:06:32 Really enjoyed it.

01:06:33 You bet.

01:06:33 See you later.

01:06:33 All right, bye.

01:06:34 This has been another episode of Talk Python to Me.

01:06:38 Our guest on this episode was Peter McKee, and it's been brought to you by Datadog and

01:06:42 us over at Talk Python Training.

01:06:44 Datadog gives you visibility into the whole system running your code.

01:06:48 Visit talkpython.fm/datadog and see what you've been missing.

01:06:52 Don't throw in a free t-shirt with your free trial.

01:06:54 Want to level up your Python?

01:06:56 We have one of the largest catalogs of Python video courses over at Talk Python.

01:07:00 Our content ranges from true beginners to deeply advanced topics like this.

01:07:04 Like memory and async.

01:07:05 And best of all, there's not a subscription in sight.

01:07:08 Check it out for yourself at training.talkpython.fm.

01:07:11 Be sure to subscribe to the show.

01:07:13 Open your favorite podcast app and search for Python.

01:07:15 We should be right at the top.

01:07:17 You can also find the iTunes feed at /itunes, the Google Play feed at /play, and the

01:07:22 direct RSS feed at /rss on talkpython.fm.

01:07:27 We're live streaming most of our recordings these days.

01:07:29 If you want to be part of the show and have your comments featured on the air, be sure to

01:07:34 subscribe to our YouTube channel at talkpython.fm/youtube.

01:07:37 This is your host, Michael Kennedy.

01:07:39 Thanks so much for listening.

01:07:40 I really appreciate it.

01:07:42 Now get out there and write some Python code.

01:07:43 Bye.

01:07:44 Bye.

01:07:45 Bye.

01:07:45 Bye.

01:07:45 Bye.

01:07:46 Bye.

01:07:47 Bye.

01:07:48 Bye.

01:07:49 Bye.

01:07:50 Bye.

01:07:51 Bye.

01:07:52 Bye.

01:07:53 Bye.

01:07:54 Bye.

01:07:55 Bye.

01:07:56 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:57 Bye.

01:07:58 Bye.

01:07:59 Bye.

01:07:59 Bye.

01:08:00 you you Thank you.

01:08:03 Thank you.