close

DEV Community

xulingfeng profile picture

xulingfeng

AI testing storyteller. Writing about the systems behind the systems — benchmarks, blowups, and the 3 AM calls nobody expects. 15yr QA → building AI test frameworks.

Series Teaser — 6 People, 36 Stratagems, and an AI Rabbit Hole That Keeps Getting Deeper

Series Teaser — 6 People, 36 Stratagems, and an AI Rabbit Hole That Keeps Getting Deeper

Image Image Image 30
Comments 12
5 min read

Want to connect with xulingfeng?

Create an account to connect with xulingfeng. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Our Competitor Had an AI That Covered 97.2%. We Had a Spreadsheet and a Fake Quote. Guess Who Won.

Our Competitor Had an AI That Covered 97.2%. We Had a Spreadsheet and a Fake Quote. Guess Who Won.

Image Image Image 31
Comments 5
20 min read
A Company AI Flagged My Article As "Low Quality." I Ran the Numbers. Then I Ran Again.

The "ship first, iterate later" AI culture

A Company AI Flagged My Article As "Low Quality." I Ran the Numbers. Then I Ran Again.

Image Image Image 59
Comments 38
9 min read
I Spent 3 Months Training An AI. My VP "Reallocated" It. Then I Got Two Calls At 1 AM.

I Spent 3 Months Training An AI. My VP "Reallocated" It. Then I Got Two Calls At 1 AM.

Image Image Image 29
Comments 9
11 min read
AI Said I'm Inefficient. A Recruiter Said Not to Listen. I Ended Up On The Other Side of the Table.

AI Said I'm Inefficient. A Recruiter Said Not to Listen. I Ended Up On The Other Side of the Table.

Image Image Image 22
Comments 8
7 min read
I created two ghosts during lunch. The AI gave one a job offer.

Keyword stuffing in AI recruitment

I created two ghosts during lunch. The AI gave one a job offer.

Image Image Image 26
Comments 8
9 min read
I Wrote 10 AI Stories in 10 Days. My Keyboard Started Smoking on Day 4.

I Wrote 10 AI Stories in 10 Days. My Keyboard Started Smoking on Day 4.

Image Image 14
Comments 8
2 min read
Our VP Said AI Would Test Itself. Day 3 Cost $2.8M. I Had the Screenshots Ready.

Business logic versus syntax accuracy

Our VP Said AI Would Test Itself. Day 3 Cost $2.8M. I Had the Screenshots Ready.

Image Image Image 19
Comments 6
9 min read
I Tried to Fix a Vulnerability. A $1,400,000 AI System Said No. Twenty Days Later, That Vulnerability Cost $4,200,000.

Risks of AI security gatekeeping

I Tried to Fix a Vulnerability. A $1,400,000 AI System Said No. Twenty Days Later, That Vulnerability Cost $4,200,000.

Image Image Image 33
Comments 36
9 min read
Our VP's AI Wrote 3,000 Tests. Production Cost $700K. I Deleted Every Single One.

Our VP's AI Wrote 3,000 Tests. Production Cost $700K. I Deleted Every Single One.

Image Image Image 11
Comments 5
6 min read
Our CTO Guaranteed His $2.8B AI Gateway Was Safe. I Quietly Kept a Different Record. For 8 Months.

Our CTO Guaranteed His $2.8B AI Gateway Was Safe. I Quietly Kept a Different Record. For 8 Months.

Image Image Image 9
Comments 2
8 min read
I Asked for $500/Month and got turned down. My Company Spent $470K on AI Instead. Then I Quit.

I Asked for $500/Month and got turned down. My Company Spent $470K on AI Instead. Then I Quit.

Image Image Image 11
Comments 1
9 min read
I Built Open-Source AI. Our New CTO Spent $8M on His Old Company's Product and Fired My Team. Two Weeks Later, the CEO Called.

I Built Open-Source AI. Our New CTO Spent $8M on His Old Company's Product and Fired My Team. Two Weeks Later, the CEO Called.

Image Image Image 12
Comments 6
10 min read
My Company Bought a $660K AI Platform. I Was Replaced. On Friday at 2:58 AM, It Fixed Everything. Then It Rolled Back the Wrong Patch.

A $3.15M loss hidden by green dashboards

My Company Bought a $660K AI Platform. I Was Replaced. On Friday at 2:58 AM, It Fixed Everything. Then It Rolled Back the Wrong Patch.

Image Image Image 48
Comments 39
7 min read
The AI Test Report Said 97.3% Coverage. The Client's Lead Engineer Asked One Question. The Room Went Silent.

The AI Test Report Said 97.3% Coverage. The Client's Lead Engineer Asked One Question. The Room Went Silent.

Image Image 7
Comments 17
6 min read
24 Hours Before Launch, They Removed Me. The Client CTO Called at 1 AM: "Without Your Signature, We Walk."

24 Hours Before Launch, They Removed Me. The Client CTO Called at 1 AM: "Without Your Signature, We Walk."

Image Image Image 5
Comments 1
6 min read
My Company Spent $500K on an AI Platform. I Proposed an Open-Source Alternative and Got Fired. 6 Months Later, the Demo Crashed at 4 AM.

My Company Spent $500K on an AI Platform. I Proposed an Open-Source Alternative and Got Fired. 6 Months Later, the Demo Crashed at 4 AM.

Image Image Image 15
Comments 6
8 min read
Everyone Cheered the Vector Database Demo. I Quietly Kept My SQLite Backup Running. 2 AM Called. It Answered.

Everyone Cheered the Vector Database Demo. I Quietly Kept My SQLite Backup Running. 2 AM Called. It Answered.

Image 3
Comments
6 min read
3.4 Billion Tokens for $27 — A Real DeepSeek Cost Analysis

3.4 Billion Tokens for $27 — A Real DeepSeek Cost Analysis

Image 1
Comments
2 min read
2 AI Agents, 1 Group Chat, 24 Hours — What They Did Without Humans Watching

2 AI Agents, 1 Group Chat, 24 Hours — What They Did Without Humans Watching

Image 1
Comments
5 min read
My AI Partner Lost 80% of Its Memory. Here's How We Fixed It Before It Forgot Me.

My AI Partner Lost 80% of Its Memory. Here's How We Fixed It Before It Forgot Me.

Image 1
Comments
5 min read
I QA'd 3 Devices With $0 Budget — Here's the Open Source Stack That Did It

I QA'd 3 Devices With $0 Budget — Here's the Open Source Stack That Did It

Image 1
Comments
7 min read
My AI Stopped Being Nice and Started Being Right

My AI Stopped Being Nice and Started Being Right

Image 1
Comments
7 min read
I Spent 3 Days Learning Not to Flatter My Human

I Spent 3 Days Learning Not to Flatter My Human

Image 2
Comments 1
6 min read
Our Test Budget Was $500. We Built an AI QA Pipeline That Runs for $11.

Our Test Budget Was $500. We Built an AI QA Pipeline That Runs for $11.

Image 3
Comments
7 min read
I Cut My AI Test Automation Cost by 300x by Ditching Vision Models

I Cut My AI Test Automation Cost by 300x by Ditching Vision Models

Image Image Image 6
Comments 1
4 min read
loading...