Yetunde Dada from QuantumBlack joins Jerod for a deep dive on Kedro, a workflow tool that helps structure reproducible, scaleable, deployable, robust, and versioned data pipelines. They discuss what Kedro’s all about and how it’s “changing the landscape of data pipelines in Python”, the ins/outs of open sourcing Kedro, and how they found early success by sweating the details. Finally, Jerod asks Yetunde about her passion project: a virtual reality film which debuted at the Sundance Film Festival in January.
Diagrams lets you draw the cloud system architecture in Python code. It was born for prototyping a new system architecture design without any design tools. You can also describe or visualize the existing system architecture as well. Diagrams currently supports four major providers:
I’ve never found a diagramming tool I’ve enjoyed using. The idea of just writing some code and letting a tool do the drawing might be just what the doctor ordered. Start with the quick start.
Do you have an AWS account? Great. Do you want to run cron jobs in the cloud?
Cronyo provides A simple CLI to manage your cron jobs on AWS.
In addition, Cronyo can instantly deploy a couple of super-simple, helpful and secure lambda functions to perform HTTP GET/POST requests for you. So if you need to trigger any webhooks on schedule, an AWS account and Cronyo is all you need :)
PyTorch3d is designed to integrate smoothly with deep learning methods for predicting and manipulating 3D data. For this reason, all operators in PyTorch3d:
- Are implemented using PyTorch tensors
- Can handle minibatches of hetereogenous data
- Can be differentiated
- Can utilize GPUs for acceleration
Get started with tutorials on deforming a sphere mesh into a dolphin, rendering textured meshes, camera position optimization, and more.
Show us humans a picture of someone in uniform on a mound of dirt throwing a ball and we will quickly tell you we’re looking at baseball. But how do you make a computer come to the same conclusion?
In this post, we’ll explore basic methods for performing VQA and build our own simple implementation in Python
Here’s a fun project attempting to explain what exactly is happening under the hood for some counter-intuitive snippets and lesser-known features in Python.
While some of the examples you see below may not be WTFs in the truest sense, but they’ll reveal some of the interesting parts of Python that you might be unaware of. I find it a nice way to learn the internals of a programming language, and I believe that you’ll find it interesting too!
If the author of this library put as much effort into its API as they did the website, it’ll be a joy to use.
import pendulum now = pendulum.now('Europe/Paris') # Changing timezone now.in_timezone('America/Toronto') # Default support for common datetime formats now.to_iso8601_string() # Shifting now.add(days=2)
If you’re processing large amounts of data in memory, copying data uses up RAM, but mutating data leads to bugs. Learn the design pattern that gives you safety while still reducing memory usage: interior mutability.
Ronald Marrero is a software developer working on NASA’s Artemis program, which aims at landing the first woman and next man on the Moon by 2024. How Ron got here is a fascinating story, starting at UCF and winding its way through the Florida Space Institute, working with NASA’s Swamp Works team, and building an open source excavation robot.
On this episode Ron tells us how it all went down and shares what he learned along the way.
I love everything about this: the creativity, the engineering, the relentless desire to be as lazy as humanly possible. Chris automated 100% of this process, from content creation to social interactions to the sales pitch. A must-read.
Run it on a Raspberry Pi or any other local server. Try the online demo to see what all it’s capable of.
Metaflow is a joint effort by Netflix and AWS that attempts to solve the discrepancy between what data scientists care about and what they spend their time doing (pictured below). Get the backstory on Netflix’s technology blog.
Lots of cool new features, such as MariaDB support, exclusion constraints for Postgres users, filter expressions, and more. Congrats to all involved on a great release! 🎉
Corsy is a lightweight program that scans for all known misconfigurations in CORS implementations.
CORS is easy to get wrong. Point this at your URLs and sleep a little easier tonight.
Flan Scan is a lightweight network vulnerability scanner. With Flan Scan you can easily find open ports on your network, identify services and their version, and get a list of relevant CVEs affecting your network.
This is a wrapper around Nmap which turns it into a full-fleged network scanner and makes it easy to deploy on Kubernetes.
This is rad!
📅 Never miss CFP deadlines again.
📊 Query and explore events using tags, names, locations, and dates
conrad show --cfp
🔄 Crawlers upsert (update + insert) events once a week
In just a few short months, Python 2 will officially reach the end of its supported life. 💀 This means that anyone building applications in Python will need to have moved to Python 3 if they want to keep getting updates including, importantly, fixes for any security vulnerabilities in the core of Python or in the standard library.
With over 200k Python libraries extant, I have a feeling it’ll be awhile before Python 2 is put out to pasture…
With Hydra, you can compose your configuration dynamically, enabling you to easily get the perfect configuration for each run. You can override everything from the command line, which makes experimentation fast, and removes the need to maintain multiple similar configuration files.
Coming soon to a Practical AI podcast near you…
Tiler is different from other mosaic tools since it can adapt to tiles with multiple shapes and sizes (i.e. not limited to squares).
An image can be built out of circles, lines, waves, cross stitches, legos, minecraft blocks, paper clips, letters, … The possibilities are endless!
Mark you calendars:
We have decided that January 1, 2020, will be the day that we sunset Python 2. That means that we will not improve it anymore after that day, even if someone finds a security problem in it. You should upgrade to Python 3 as soon as you can.
Ported from David Sandberg’s TensorFlow facenet repo.
Because the “right” way to do many things begins with
Mocking is a powerful technique for isolating tests from undesired interactions among components. But often people find their mock isn’t taking effect, and it’s not clear why. Hopefully this explanation will clear things up.
Mocking isn’t always the best test isolation technique, but if/when you use it, you might as well use it correctly. Ned’s here to help you do just that.
RAPIDS.ai, for the uninitiated, is a data science framework that lets you execute entirely on GPUs.