DeveloPassion's Newsletter - Prompt engineering

By Sébastien Dubois • Issue #85 • View online

Hello everyone! I’m Sébastien Dubois, your host. You’re receiving this email because you signed up for DeveloPassion’s Newsletter. Thank you for being here with me ✨

If you enjoy this newsletter, then become a supporter ❤️

Welcome to the 85th edition

Another week, another newsletter! I hope that you all had a great one 🤩

This week I spent quite some time playing with stable-diffusion and exploring its possibilities. My mind is still blown by the fact that the dataset is < 10GB. I also can’t wait for the general availability of the 1.5 version.

I started exercising again, and managed to hurt my back already. Go me 😂. On other news, my son Raphaël is now 1 year old. Time flies!!

I really need your help. If you get value from this newsletter, please consider becoming a supporter. You’ll be able to join the curious minds private community and meet like-minded people while enabling me to keep creating content. If you prefer, you can also buy one of my products on Gumroad or buy me a ~~coffee~~ tea.

Alright, let’s goooo! 🚀

Prompt engineering and security

During the last few months, my interest in AI image generation has grown a great deal. It started with me reading about DALL-E, and realizing how much potential this has for creativity, and was renewed with the release of stable-diffusion under an Open Source license.

Compared to DALL-E, stable-diffusion has very important advantages:

It’s free
It’s open source, so it can be inspected and modified
It can be downloaded and used on any computer with a recent GPU
…

Since the release of stable-diffusion, there has been an insane amount of innovation from the open source community. User interfaces have been released, tutorials, modified versions, guides on how to disable filters, etc.

It’s really an understatement, but the pace of innovation there is astounding. And it will only keep accelerating, as more and more people discover it. People are already experimenting with video.

Stable Diffusion: Is Video Coming Soon? - Metaphysic.ai

For an excited public, many of whom consider diffusion-based image synthesis to be indistinguishable from magic, the open source release of Stable Diffusion seems certain to be quickly followed up by new and dazzling text-to-video frameworks - but the wait-time might be longer than they’re expecting.

metaphysic.ai • Share

As a content creator, my main interest in the technology is in adding images that look a bit different from the usual stock images from Unsplah and the like. With stable-diffusion, I can easily generate images that match the content and provide a more “immersive” experience for my readers.

As a creative person, it’s also really fun to use this technology to create art and mixing different tools, techniques and genres together.

As a parent, the technology is also fascinating, both for fun and for education. I intend to spend time with my kids to show them the cool stuff we can do with technology today. I have no doubt that many tools and apps will appear to put this technology into the hands of more and more people.

One key thing to understand with this technology is that the text used to generate images is of the utmost importance. If you just use “cat”, then you’ll get a cat, that’s for sure, but not necessarily something great. Instead, you need to provide long and very clear descriptions of what you want to be generated. This requires some skill and experience. I’m convinced that this skill will become more and more important over time, as this technology matures. It might very well become a new job type in the future. Smart people have already started creating ways to share/monetize useful prompts. I also found some useful guides on the topic, including a list of open source prompts that will surely grow.

Arki's Stable Diffusion Guides

Stable Diffusion Guides by Arki

stablediffusionguides.carrd.co • Share

Simon Willison

@simonw

The stuff happening on the Stable Diffusion subreddit right now is pretty wild - since the model can be run by anyone on their own machine if they have a decent GPU https://t.co/pJnR4czUlG

5:54 PM - 27 Aug 2022

Simon Willison

@simonw

It's now possible to train the Stable Diffusion model to apply a new style with just 3-5 new sample images https://t.co/ElPzZOichy

12:43 AM - 7 Sep 2022

If you’re curious to learn more, do give Simon a follow, he’s got really interesting content on the topic. Also, check out the sub-reddit dedicated to stable-diffusion.

Prompt injection attacks against GPT-3

Your description for this link…

simonwillison.net • Share

There are legitimate concerns about this technology being open source, but I am convinced that it was just a matter of time anyway. OpenAI would have been hacked at some point and their code released into the wild. I’m curious about what the future holds, but the ITSec community is clearly already facing new challenges with OpenAI and image generation AIs like DALL-E and stable-diffusion. For instance, bots using GPT-2 and GPT-3 are already being abused via “prompt injection” attacks. They’re normally “configured” to act a certain way, but well-crafted prompts can modify the behavior of the bots. “Fun” stuff 😂

The Lab 🧪

I didn’t make any progress on the video recording front. Frustrating as it is, I didn’t have much free time. I decided to prioritize health and family, so the business didn’t get much attention.

I’ve started exploring ideas for a new project in the community space. I have good hopes that it might turn into a wonderful calm business. I’ll let you know more once it’s time!

This week I’m going to give one more try to the video recording, and I’m also going to write new guides for the Obsidian Starter Kit.

I’ve passed $6K revenue on Gumroad, which is really cool 🎉

Last but not least, the Google Search Console continues to give me good vibes. The upward trend continues to accelerate:

Google search results of dSebastien.net over the last 12 months

Recent articles

Calm businesses are a viable path too

Startups and fast growth are not the only way. Creating a calm business is also a viable path to success

dsebastien.net • Share

Quotes of the week

“If you don’t design your own life plan, chances are you’ll fall into someone else’s plan. And guess what they have planned for you. Not much” — Jim Rohn
“We don’t rise to the level of our expectations, we fail to the level of our training” — Archilochus
“It is not because things are difficult that we do not dare. It is because we do not dare that things are difficult” — Seneca
“The point of PKM is not to build a second brain, but to empower the one you already have”

Book of the week

The E-Myth Revisited: Why Most Small Businesses Don't Work and What to Do About It: Gerber, Michael E

This is the book I’ve started reading. It’s been on my radar for a while, and now is the right time for me to dive into it.

The E-Myth aims to debunk the myths around entrepreneurs and entrepreneurship. As a systems thinker, I can only with the idea that businesses are complex systems composed of inter-dependent processes that can and should be improved continuously. There’s no magic trick, no silver bullet, except having the right mindset, taking some distance to make better decision, and showing up and again, never assuming that the system is perfect as it is and doesn’t require any more efforts. The world is ever-changing, and businesses need to follow along.

amzn.to • Share

Tips of the week

NMKD Stable Diffusion GUI - AI Image Generator by N00MKRAD

Generate AI images on your own GPU for free

Check it out if you want to easily explore what stable-diffusion can do

nmkd.itch.io • Share

How cool is that?!

Knight Cat : StableDiffusion

Welcome to the unofficial Stable Diffusion subreddit! We encourage you to share your awesome generations, discuss the various repos, news about…

www.reddit.com • Share

This House Does Not Exist

A new cool project created by Pieter Levels

levels.io • Share

Applying img2img to video: 3D Aladdin : StableDiffusion

Welcome to the unofficial Stable Diffusion subreddit! We encourage you to share your awesome generations, discuss the various repos, news about…

www.reddit.com • Share

Thinking and learning links of the week

Gardner's Theory of Multiple Intelligences

The theory of multiple intelligences suggests eight types of intelligence that people may possess. Learn more about the theory, the types, and how to use it.

www.verywellmind.com • Share

Brodart Library Supplies for the Analog Zettelkasten Enthusiast | Chris Aldrich

So you’ve taken the plunge and purchased an old school library card catalog, or maybe you want to but haven’t hit critical mass of cards to justify the purchase yet? Certainly you’ve found the traditional index card supplies still available at every office supply store on the planet, but did you know there’s still at

boffosocko.com • Share

Verywell Mind - Know More. Live Brighter.

Whether you want to better manage stress, understand a mental health disorder, or learn why we dream, get the guidance you need to be healthy and happy.

www.verywellmind.com • Share

PKM Weekly Sept 17 2022 – Issue 036 – Curtis McHale

curtismchale.ca • Share

PKM Weekly August 28 2022 – Issue 033 – Curtis McHale

Your description for this link…

curtismchale.ca • Share

Readsom - Discover content you’ll want to read

Readsom hosts newsletters that are handpicked and filtered through topics to help you find your niche of interest. Explore and discover your next favorite newsletter.

readsom.com • Share

🌠 Dataview Example Vault, Book Club, & Ecosystem Stats

Memes about minimalism, bullet backlinks plugin, timeshifting, a book club, and an upcoming mystery event.

www.obsidianroundup.org • Share

Tech links of the week

Keep your Playwright tests structured with steps - Tim Deschryver

Leverage the Playwright test.step function to divide your tests into logical steps. These steps create a well-organized summary in the Playwright report and have the benefit that tests become more readable and easier to maintain, especially when a failed test is displayed in the Playwright report.

timdeschryver.dev • Share

Strongly Typed JSON in TypeScript - Just Some Dev

Someone in one of the Slack communities I’m a part of asked today how to type JSON in TypeScript,…

www.iamdeveloper.com • Share

A toolbox for a secure software supply chain

blog.chainguard.dev • Share

Introduction · Tig - Text-mode interface for Git

jonas.github.io • Share

GitHub - crazy-max/WindowsSpyBlocker: Block spying and tracking on Windows

Block spying and tracking on Windows. Contribute to crazy-max/WindowsSpyBlocker development by creating an account on GitHub.

github.com • Share

jEnv - Manage your Java environment

Discover jenv, the command line Java manager

www.jenv.be • Share

Indie Hacking and bootstrapping

Lessons from 165+ IndieHackers Posts about Online Courses

I have a few years of experience teaching in-person, but as I prepared to create an online course for the first time, I needed some guidance. Luckily, t…

www.indiehackers.com • Share

This 38-year-old makes $160,000 per month in passive income—after losing his job: 'I work only 5 hours a week now'

After losing his full-time job as an audio engineer, Graham Cochrane started a music blog. Now, the 38-year-old father makes $160,000 a month working just five hours per week — and spends most of his time with his family.

www.cnbc.com • Share

How do you build your communities?

In the past, I build a “community” through the following sequence: 1. I write articles that provide value to my target audience 2. I post the said artic…

www.indiehackers.com • Share

MATT GRAY

@matt_gray_

I've tweeted 156 days in a row.

And added 41k+ followers.

Here are 4 simple lessons:

1. Write 2 threads per week
2. Engage with 15 people daily
3. Share 2 useful posts per day
4. Comment under large accounts

Stay consistent.

It's simple.

2:07 PM - 16 Sep 2022

I'm giving myself a 6-months deadline

www.indiehackers.com • Share

Building Things and Raising Children | Swiftjective-C

Indie life has never been quite within reach than ever before. So, how do you build things while raising children?

www.swiftjectivec.com • Share

That’s all folks!

If you want to support my work, become a supporter and share the link with your friends: https://newsletter.dsebastien.net ❤️

PS: When I link to products on Amazon, I almost always use affiliate links, as those generate a bit of $$$.

Did you enjoy this issue?

Become a member for €5 per month

Don’t miss out on the other issues by Sébastien Dubois

Become a member

By Sébastien Dubois

Get Sébastien's free weekly newsletter. Read by hundreds of people to explore and stay up to date on learning, personal knowledge management, personal organization, software development, and bootstrapping.

Tweet

Share

You can manage your subscription here.

If you were forwarded this newsletter and you like it, you can subscribe here.

Powered by Revue

193 rue des Masnuy, 7050 Jurbise, Belgium

diffusionbased image synthesis Open Source license one key thing Stable Diffusion subreddit open source community open source prompts new job type AI image generation usual stock images Stable Diffusion Guides open source release

DeveloPassion's Newsletter - Prompt engineering

Key phrases

Older messages

DeveloPassion's Newsletter - Midweek Links #9

DeveloPassion's Newsletter - Calm Business

DeveloPassion's Newsletter - Eyes on target

DeveloPassion's Newsletter - Back to it

DeveloPassion's Newsletter - Misguided

You Might Also Like

Data Science Weekly - Issue 543

A deal made in cloud security heaven

💎 Issue 413 - RubyJS-Vite

💻 Issue 406 - Swift for C++ Practitioners, Part 1

💻 Issue 413 - How to implement HLS Video Streaming in a React App

📱 Issue 407 - Textual Healing: iOS Text Editing Minutiae

💻 Issue 413 - Interview with Senior JavaScript Developer 2024 [video]

💻 Issue 331 - 30+ app ideas with complete source code

💻 Issue 408 - Curl: Hyper, is it worth it?

📱 Issue 410 - Swift for C++ Practitioners, Part 1