Each stage I progress to, I’ve had to drop max_tokensdown further and further until I got it to 100 tokens, and I still hit the 402 error about credit limits and can no longer continue the challenge:
[your_program] OpenAI API Error: 402 This request's maximum cost exceeds your available credits. Add credits, or lower max_tokens or prompt size.
[your_program] OpenAI API Error: 402 This request would exceed your available credits given your
current in-flight requests. Retry after in-flight requests settle, or add credits.
[your_program] OpenAI API Error: 402 This request requires more credits, or fewer max_tokens. You requested up to 256 tokens, but can only afford 57. To increase, visit https://openrouter.ai/settings/credits and add more credits
Don’t think 57 tokens for a request is enough to pass any tests…
Also, it seems like the test runner is self-destructing because it comes up with random flaky errors like:
[tester::#OQ5] Expected file README_old.md to not exist, but it exists
[tester::#OQ5] Test failed
Works fine locally using a free OpenRouter model.
Question: why hardcode it to Haiku 4.5? Allowing free models on the remote end would save y’all a few pennies at least.