Privacy Policy
Last Updated: June 29, 2025
1. Introduction
Welcome to Benchable. We are committed to protecting your privacy. This Privacy Policy explains how we collect, use, disclose, and safeguard your information when you visit our website and use our services. Please read this privacy policy carefully. If you do not agree with the terms of this privacy policy, please do not access the site.
2. Information We Collect
We may collect information about you in a variety of ways. The information we may collect on the Site includes:
- Account Information: When you register for an account, we collect your username, email address, and hashed password.
- API Keys: If you choose to use our "Bring Your Own Key" (BYOK) feature, we will store your API keys in an encrypted format.
- Benchmark Data: We store the benchmarks you create, including prompts, configurations, and associated files. You must not upload any personally identifiable information (PII) or sensitive personal data within your benchmark definitions, prompts, or uploaded files. Benchable is not designed for storing or processing PII within benchmark content, and you are solely responsible for the data you provide.
- Usage Data: We collect information about your interactions with the service, such as executed benchmarks, model usage, and feature engagement to improve our services.
3. Analytics and Cookies
We use Google Analytics 4 (GA4) to understand how visitors use our website and to improve your experience. This section explains what data is collected, how it's used, and how you can control it.
3.1 Opt-In Analytics Tracking
No tracking cookies are set until you explicitly accept. We follow a strict opt-in approach for all analytics tracking:
- First-time visitors see a cookie consent banner with clear Accept/Decline options
- Analytics tracking only begins after you click "Accept Analytics"
- You can change your preference at any time via the cookie banner or your Profile Settings
- Anonymous users who decline or ignore the banner receive no tracking
3.2 What Data is Collected
When you consent to analytics tracking, Google Analytics may collect:
- Page Views: Which pages you visit and how long you spend on them
- User Interactions: Clicks on buttons, form submissions, and feature usage (no form content is tracked)
- Technical Information: Browser type, device type, screen resolution, and general location (country/region)
- Anonymous Identifiers: Generated by Google to understand unique visitors (no personal information)
3.3 What Data is NOT Collected
We have configured Google Analytics to protect your privacy:
- No Personal Information: Usernames, email addresses, API keys, or benchmark content are never sent to analytics
- IP Anonymization: Your IP address is anonymized before processing
- No Ad Tracking: Google Signals and ad personalization are disabled
- No Cross-Site Tracking: Analytics is limited to our domain only
3.4 How We Use Analytics Data
Analytics data helps us:
- Understand which features are most valuable to users
- Identify and fix usability issues
- Optimize page loading performance
- Plan new features based on user behavior patterns
3.5 Managing Your Analytics Preferences
You have full control over analytics tracking:
- Cookie Banner: Accept or decline when first visiting the site
- Profile Settings: Change your preference anytime in your user profile
- Browser Settings: Block analytics entirely through browser privacy settings
- Immediate Effect: Changes take effect immediately using GA4 Consent Mode
3.6 Data Retention and Deletion
Analytics data is subject to Google's data retention policies. If you request account deletion, we will also request deletion of your associated analytics data where technically feasible.
3.7 Third-Party Analytics Policies
Our use of Google Analytics is also governed by:
4. Use of Your Information
Having accurate information about you permits us to provide you with a smooth, efficient, and customized experience. Specifically, we may use information collected about you via the Site to:
- Create and manage your account.
- Provide and manage our services, including benchmark execution and results analysis.
- Improve our website and services.
- Monitor and analyze usage and trends to improve your experience with the Site.
- Notify you of updates to the service.
- Respond to your comments and inquiries.
5. Disclosure of Your Information
We do not share your personal information with third parties except as described in this Privacy Policy or with your consent. We may share information with:
- Service Providers: We may share your information with third-party vendors, service providers, contractors, or agents who perform services for us or on our behalf and require access to such information to do that work (e.g., email delivery, hosting services).
- Legal Requirements: We may disclose your information if required to do so by law or in the good faith belief that such action is necessary to comply with a legal obligation, protect and defend our rights or property, prevent or investigate possible wrongdoing in connection with the Service, or protect the personal safety of users of the Service or the public.
6. Security of Your Information
We use administrative, technical, and physical security measures to help protect your personal information. While we have taken reasonable steps to secure the personal information you provide to us, please be aware that despite our efforts, no security measures are perfect or impenetrable, and no method of data transmission can be guaranteed against any interception or other type of misuse.
Specifically regarding benchmark data, it is your responsibility to ensure that no PII is included. We are not liable for any PII you choose to include in your benchmarks.
7. Your Data Rights
You have certain rights regarding your personal information, including the right to access, correct, or delete your personal information. You can manage your account information and API keys through your user profile. For other requests or if you have any questions, please contact us.
7.1 Analytics Data Management
For analytics data collected through Google Analytics, you have the following rights and options:
- Opt-Out at Any Time: You can disable analytics tracking through your Profile Settings or via the cookie consent banner
- Data Deletion Requests: If you delete your account, we will make commercially reasonable efforts to request deletion of associated analytics data from Google Analytics
- Google's Data Controls: You can also use Google's privacy controls to manage analytics data
- Browser Controls: You can block analytics tracking entirely using browser privacy settings or ad blockers
7.2 Account Deletion Process
When you request account deletion, we will:
- Immediately disable your account access
- Delete your personal information (username, email, encrypted API keys) from our systems
- Remove or anonymize your benchmark data and execution results
- Request deletion of associated analytics data from Google Analytics (where technically feasible)
- Retain only necessary audit logs for security and compliance purposes
7.3 GDPR and CCPA Rights
If you are located in the EU, UK, or California, you have additional rights under applicable privacy laws:
- Access: Request a copy of the personal data we hold about you
- Rectification: Request correction of inaccurate personal data
- Erasure: Request deletion of your personal data ("right to be forgotten")
- Portability: Request export of your data in a structured, machine-readable format
- Restriction: Request limitation of how we process your personal data
- Objection: Object to our processing of your personal data
- Automated Decision-Making: Request review of automated processing (not currently applicable)
To exercise these rights, please contact us at privacy@benchable.ai with your request. We will respond within the timeframes required by applicable law (typically 30 days).
7.4 Data Export
You can export your benchmark data and configurations at any time through the application's export features. For a comprehensive data export including all personal data we hold, please contact us at privacy@benchable.ai.
8. Changes to This Privacy Policy
We may update this Privacy Policy from time to time. We will notify you of any changes by posting the new Privacy Policy on this page and updating the "Last Updated" date. You are advised to review this Privacy Policy periodically for any changes.
9. Contact Us
If you have questions or comments about this Privacy Policy, please contact us at: privacy@benchable.ai