Is it not an issue if your group becomes less powerful than other groups? You are then putting yourself at their mercy, and we cannot assume that everyone has the same values (they don't).
Sure of course, I was too vague. I’m not referring to our descendants having different values from us or myself. We do have some control over that, but not complete control, and exerting whatever control is available in the modern day risks future blowback. We are in agreement here.
I’m referring to the value of not persecuting based on ethnic or cultural background.
Not everyone in the world holds this value, and relocating to different land is not what makes a person hold one value or another.
So if groups who don’t hold this value grow numerically to the point where the lack of this value becomes dominant, we are putting our own group at risk of being subjected to it in the future, which seems rather unwise.
You shouldn't be OK with them having any random values, either.
If you have a civilization, you have a vision about life, and what's good and what's bad, and you want to see it to continue.
That some of them will inevitable change over time is not the same as you preactively having no preference and guidance for your offspring whatsoever, and thinking "no problem, anything goes".
> If you have a civilization, you have a vision about life,
Do you?
Your 'civilization' doesn't run on some kind of command economy five-year-cultural plan. Its values and views of what's good and bad are just some (often dystopian) local maximum it's stuck in.
Not to mention the obvious - what if you strongly disagree with your civilization's values?
A group having more power has little to do with numbers. If that was the case the rich would be more numerous than the poor, and India would be the most powerful country in the world.
The "power" of a country, however you define it, lags the population growth. China was the biggest country for decades, its power only really started exploding some 10 or 15 years ago.
That's an incredibly short sighted way of looking at countries. The US was never the country with highest population growth, and right now is also heading into a demographic collapse.
Yes, it does document it, it might be a little hard to find because it's quite large, there's even a GIF showing it if you want to see it, if you could give it a star to help I would appreciate it!
> When the first few emails in a batch were obvious prompt injections, the agent became more suspicious of everything that followed. I had to change the setup so that each email was processed in a fresh context.
Both were noted, but then the conclusion drawn from these things is that the author is considerably more optimistic about the agents. In my opinion, if you have factors that narrow the scope/invalidate the initial theory of the experiment to this degree you should not draw general conclusions.
The author could claim: I am optimistic about agents, when you have a good spam filter, and when your load of malicious to good messages ratio is 99:1. This is quite different from a common scenario where this would be used.
If you have a confounding variable or a dependency that influences the experiment to a degree that invalidates the premise of the experiment, you need to put more weight on this in the conclusion.
For me this reads a bit like if I added an AI software that scans for shoplifters, and then placed a security guard at the exit of the store that watches the people shopping at the same time, and then said that the AI software is responsible for the reduction of the shoplifting without accounting for the influence of the guard.
If you have place the model in the embedding space of 99% negative samples, it's doing the same thing, the initial premise of the experiment is not valid.
If you have to pay, at least try to negotiate 1) a guarantee that the hackers won't just do it again sometime later, and 2) full disclosure / assistance in repairing your vulnerabilities so you have some kind of head start for the future. Outside of politically motivated hackers, this would probably be reasonably successful.
We are in the context of already having to pay. You are at their mercy no matter what, so the only value of any interaction with them is based on hoping they have incentive to maintain their promises to protect their reputation etc.
It's not a good situation to be in, but still, try to make the best of it.
> Yes, I know which “major computer manufacturer” it is, and no, I’m not telling. This is consistent with longstanding blog policy that companies are not identified in stories, because the point of the story to teach something, not to call out companies for derision.
That's kind of a pathetic excuse, because it means that the "something" the story teaches is highly limited and there's nothing concrete for the reader to use as the basis for a deeper investigation.
reply