Option to throttle usage
Include an option to throttle the number of messages - to counteract possible abuse and control costs (especially important on expensive gpt models).
Include an option to throttle the number of messages - to counteract possible abuse and control costs (especially important on expensive gpt models).
Log in to comment and vote
Comments1
Botsheets Admin
Feb 21, 2024
Yes, we do rate limiting now on the backend to counteract abuse. The thinking was that we can be proactive and protect everyone (including us if people use our credits) rather than put the onus on the user. Extending that limit management to users is possible, but it's certainly within the realm of acceptable right now for lead gen and support use-cases.