AB Testing the Credit Economy in AI Labs
Credits are the heartbeat of AI Viral Test Lab. Here s how to experiment with allowances, share rewards, and pricing while keeping the community happy.
1. Segment by client_id
Assign users to buckets by hashing their `client_id`. Bucket A gets 5 free credits, Bucket B gets 6. Because credits reset daily, we run tests for at least seven days to account for weekday/weekend behavior.
2. Track key metrics
- Runs per day
- Shares per user
- Checkout conversion
- Average credit balance at midnight
We log these metrics to BigQuery via nightly cron jobs so we can slice by variant.
3. Test pack pricing carefully
Stripe metadata includes `pack_id`, so you can run experiments where 20 credits cost $4.49 for a subset. Email receipts mention the price to avoid confusing customers.
4. Communicate changes
Before launching a big experiment, we post in Discord and update the blog so creators understand why their daily allotment shifted.
Further reading