There was a limit spent setup on my bank, however the crazy part is that one of the Agent somehow switched between cards once that limit was reach, all without informing me, probably using the computer use skill.
Actually this was a company CC with a limit is 50 K \ month, which is kind of normal to run the server for an AI company, and the money were taken across 20 days inJuly and August. By the way I am the CTO of the company in question which is Eternal Tech (see detwin.ai)
I created the account 2 hour ago because I am trying to let people know. I provided my name, and all details in the article including the case ID that was opened.
The user evidently had no spending protections enabled at any level. It makes no sense that none of the OpenAI or bank controls kicked in or even sent alert emails as they actually do send. Anyone with half a brain would know to not run AI without a hard cap on its expenses.
I have the same impression that I tried to reject in the past, there is a heavy PR machinery here to control the course of discussion in a particular direction. The reality is that a lot of money is riding on it so its natural consequence.
Yes its part of business, lobbying is legal for those reasons. However IMO discrediting some one else is a risky legal move. I used to appreciate the HN mods jumping in discussions at times for the reputation of this community, lately that part seems to be missing too.
> humans remain responsible, agents don't go rogue
^^^ 100% this ^^^ - It's either a serious flaw in the agent/harness software, or a user error in usage/configuration or prompting. Either way, it's a human somewhere responsible for these outcomes.
> should put some billing controls in place
At the very least, yes! These things should never be running without any limits on what they can do without some human signoff on important/dangerous actions. Not only should they have controls on those actions, but those controls should absolutely have some sane default settings.
OK so you've got a brand new throwaway HN account, and you're fear mongering about what exactly?
Rogue agents that somehow went crazy launching $80k worth of API requests?
And they're expecting you to pay for it still and not responding?
This seems like a nothingburger to be honest.
Either that, or you're one of the thousands of fake bots or paid shills designed to drum up fear about "Oh noes, AI is going to eat our children, training must be regulated by big brother!".
44 upvotes on this bullshit post within 13 minutes and counting ... that's some kind of record on HN.
My name is Lorenzo Massaro and I actually am the CTO of Eternal Tech, an AI company out of Italy building the product detwin.ai
I have posted here to try to reach OpenAI before seeking legal advise from a USA lawyer to follow my case.
And yes, I provided above the ticket number I opened on the OpenAI support as well.
You have access to this kind of money and have no idea how to set safeguards on your AI harnesses?
Did you just walk in off the street or something? To wherever you're working?
Where do you work, anyways?
Hope this gets some visibility idk why it's flagged guess the PR guys for those companies are doing it
Should spread this around
They're protecting their interests, and honesty and truthfulness be damned. Those two lead to much worse returns for them and much higher risk.
^^^ 100% this ^^^ - It's either a serious flaw in the agent/harness software, or a user error in usage/configuration or prompting. Either way, it's a human somewhere responsible for these outcomes.
> should put some billing controls in place
At the very least, yes! These things should never be running without any limits on what they can do without some human signoff on important/dangerous actions. Not only should they have controls on those actions, but those controls should absolutely have some sane default settings.
most are not as granular as we'd like, but seem to be headed in that direction finally, regardless, there are card limits and alerts
Rogue agents that somehow went crazy launching $80k worth of API requests?
And they're expecting you to pay for it still and not responding?
This seems like a nothingburger to be honest.
Either that, or you're one of the thousands of fake bots or paid shills designed to drum up fear about "Oh noes, AI is going to eat our children, training must be regulated by big brother!".
44 upvotes on this bullshit post within 13 minutes and counting ... that's some kind of record on HN.