AI, LLM create vulnerable software

First: AI, LLM are a very powerful tool for software developers. 

The following lines will indicate a limit of LLM in software development. 

So you aware of it and can handle it right. 

I found this problem by incident. LLM like qwen3-coder:30b generating code that uses outdated libs and frameworks containing CVE's. 

 

Conclusions 

1.  LLM's are not perfect writing code but don't drop it.
2. Many (Most, All) LLM's living in the past.
3.  LLM's  generate projects with outdated vulnerable dependencies. Be aware of it.  This will time problem will affect all ideas the LMM is generating.

Test

 The task: create a Spring Boot web app with qwen3-coder:30b (ollama, aider) 

1. pom.xml contains Spring Boot Starter Parent 2.7.0, uh that's a little bit outdated
2. Release date was May 19, 2022
3. contains at least 10 CVEs
4. Select Java 11 

Ok, I give a helping hand 

1. Task: create a spring boot web app, spring boot 4 
2. pom.xml contains Spring Boot Starter Parent 3.2.0, uh that's a little bit less outdated
3. Release date was November 23, 2023
4. contains at least 2 CVEs
5. Select Java 17

Looks that the model is living in the past, at least 2 years. So I give are more modern model a try: qwen3.6:27b 

1. Task: create a spring boot web app, spring boot 4  
2. pom.xml contains Spring Boot Starter Parent 3.3.0, best I can get but still far away, gives me a hint to 4.0.0-M1 
3. Release date was May 23, 2024 
4. contains at least 7 CVEs 
5. Select Java 17 

 

Will AI aka LLM replace Software Developers?

Question

Will AI aka LLM replace Software Developers?

Short answer 

No. The rising of LLM will increase the demand of software developers. 

 

 

Longer Answer

A LLM can generate text based on the training data. That's brilliant if you  doing you homework or writing a message a teacher (South Park episode "Deep Learning"). If you search for information, LLM are brilliant, comparing things, aggregate information that the jobs LLM can help you a lot.

 But Coding, writing software; is not writing text. If you want to learn a programming language, a LLM is great. If you searching for boiler plate code or a strange configuration property, LLM is my tool of choice. That's not coding. That's a advancment over Google or Stack Overflow. A LLM can improve autocomplete in my IDE (Kai Lentit on Y). LLM can't write software that is correct, that is fast, that is reliable, that is save, that is robust, that you and your business can rely on. So far, LLM has never been able to handle any programming task for me that went beyond the beginner level. And believe me, I tried it hard and I found out this a general limitation of LLM. I can explain it, but it's an other story.

LLM is great of doing Bullshit jobs. It will free people for better jobs. LLM increase the efficiency of software development in general. 

LLM is a good new tool, but a fool with a tool is still a fool, with brand new legacy code. LLM is a just a tool like Excel or the Internet, LLM is just a high sophisticated tool (2026). 

 

Summary

1. LLM increase the software development efficiency
2. LLM lower the entry level for software development
3. IMHO LLM will create a Rebound Effect on software development
4. LLM will help to create more Software faster
5. Software Developper will be more important than before.