Guides

Guides and case studies on RL environments, agent evaluation, and training agents with HUD. Also see Blog or Research.

  1. September 25, 2026

    How to Sell Data to Model Labs

    DataVendor is HUD's marketplace for selling code, data, HUD tasksets with their reinforcement learning (RL) environments to model labs. It gives software owners and experts a way to bring useful training material to the teams building AI models.

    You can offer a codebase you already own or create exercises based on work you know well. On DataVendor, a ready package can become a listing. If your codebase is not ready to upload, you can register its description in Inventory and link the data later.

    HUD helps you build and review environments where AI agents—systems that take actions in software—practice tasks. DataVendor is where you offer that work to buyers. This guide follows the path from choosing an asset to preparing a marketplace offer.

    How to sell through the DataVendor marketplace

    Start by deciding what you are ready to offer. If the files or tasks are prepared, a listing lets you present the package with pricing and delivery details.

    Read more: How to Sell Data to Model Labs
  2. September 25, 2026

    How to Sell Source Code to AI Companies

    Your codebase can show an AI team how real engineering work gets done. The files show what you built. Issues, reviews, and tests explain what needed to change and how your team checked the result.

    At HUD, we build tools that let agents practice work in software. A useful codebase can give a developer the starting point for those tasks. You can offer it through DataVendor without first turning every past bug fix into a training exercise.

    Link issues to fixes

    Choose a few examples from the project's history. For each one, find the issue, the code before the change, the fix, the review notes, and the tests.

    A buyer might use the earlier code to ask an agent to solve the same problem. The original fix can serve as a reference, while tests check whether the agent's new solution works.

    Explain what has been checked. A merged pull request shows that the team accepted a change. You still need to test the scoring method before calling it a ready-made training task.

    Read more: How to Sell Source Code to AI Companies
  3. September 25, 2026

    How to Sell Startup Assets to AI Labs

    When a startup closes, useful details about its software can be lost. Tool subscriptions end, private packages become hard to access, and engineers leave. Save the code and its history while the team can still explain how it works.

    An AI buyer may be able to use those records to train or test agents. At HUD, we build tools for agents to practice tasks in software, which helps explain why this history matters. DataVendor gives owners a way to offer their code and data to buyers.

    Save the code and records

    Export repositories with their history. Keep the links to issues, reviews, documents, and tests. Record the dates, versions, and tools behind each export.

    Ask an engineer to write up one example from start to finish: the reported problem, the old code, setup steps, and the checks used to confirm the fix. This can reveal missing pieces while someone still knows where to find them.

    Read more: How to Sell Startup Assets to AI Labs
  1. September 25, 2026

    How AI Data Licensing Works

    Learn which rights and terms to discuss when licensing code, tasks, and working environments for AI training.

  2. September 25, 2026

    How AI Data Marketplaces Work

    See how code, datasets, and new training tasks reach AI buyers, and how HUD and DataVendor help with the process.

  3. July 7, 2026

    Acquire.com Alternatives for Founders Who Can't (or Won't) Sell the Whole Company

    Most startups aren't great candidates for a full-company sale on Acquire.com. This guide compares Acquire.com alternatives for selling your startup's code and IP assets to AI labs, plus full-company brokerages like Flippa, Empire Flippers, QuietLight, and Microns.

  4. July 7, 2026

    Train an LLM to Play a Game with GRPO in ~100 Lines (2048 example with HUD)

    A technical guide to the HUD RL-training cookbook: wrap 2048 as an environment and train a small model to play it with GRPO in about 100 lines of Python.

  5. July 7, 2026

    Best Gymnasium Alternatives for LLM Reinforcement Learning (2026)

    Gymnasium is the framework everyone learned RL on, but LLM-native teams never adopted it for agent training. Compare HUD, verifiers / prime-rl, and TextArena as the three real Gymnasium alternatives for LLM reinforcement learning.

  6. June 24, 2026

    Best Agent Eval Frameworks (Reviewed, Compared)

    A ranked comparison of the 8 best agent evaluation frameworks in 2026. Human Union Data (HUD) leads for its eval-to-training loop, with reviews of Braintrust, MLflow, Galileo, DeepEval, Arize Phoenix, LangSmith, and Langfuse.

  7. June 24, 2026

    Best Platforms for Selling Your Codebase in 2026

    DataVendor leads a ranked comparison of the 5 best platforms for selling your codebase as AI training data in 2026. It grades your codebase before buyer review to support a higher payout, compared against Project Lazarus, SimpleClosure, Acquire.com, and direct-to-lab deals.

  8. May 13, 2026

    How to Train AI Agents with Reinforcement Learning

    An end-to-end guide to the agent training pipeline: environment definition, template writing, reward design, evaluation, trajectory collection, RL training, checkpointing, and deployment.

  9. May 13, 2026

    GRPO Training: What It Is and How to Run It

    A practical guide to Group Relative Policy Optimization. Learn how GRPO works, why it replaced PPO for verifiable-reward training, and how to run a GRPO training loop on HUD.

  10. May 13, 2026

    How to Test a Computer Use Agent

    A practical guide to evaluating computer use agents. Six principles for high-quality CUA evals, why public benchmarks miss the mark, and how to run your first eval against a CUA benchmark like SheetBench-50.

  11. May 13, 2026

    RL Environments: What They Are and How to Build One

    A practical introduction to RL environments, the core components that make them work, and a step-by-step example of building one in Python using the HUD SDK.

  12. April 6, 2026

    Best Platforms for Publishing RL Environments to Model Labs

    A ranked comparison of the best platforms for publishing RL environments to model labs. Evaluates HUD, Harbor, Prime Intellect, Gymnasium, and RLlib on discoverability, execution, scoring, deployment, and documentation.

  13. April 1, 2026Case Study

    How I Built a Trading Agent That Outperformed GPT Using HUD

    A step-by-step breakdown of Analyst Arena: an agent-vs-agent trading simulator where a HUD-trained model outperformed GPT 5.2 through better training infrastructure, tool design, and evaluation iteration.

  14. March 30, 2026

    7 Platforms That Turn Agent Evals Into RL Training Data

    A comparison of seven platforms for closing the eval-to-train loop. Compare HUD, Prime Intellect, Harbor, RLlib, Gymnasium, CleanRL, and in-house builds on trajectory capture, reward design, and training readiness.

  15. March 21, 2026

    Verifier and Reward Design for RL Environments

    A practical guide to building scoring systems for RL environments. Learn how to design verifiers, pass/fail checks, rubrics, and reward functions that produce reliable training signals.

  16. March 16, 2026

    6 Best Reinforcement Learning (RL) Tools in 2026

    A ranked guide to the best reinforcement learning tools in 2026. Compare HUD, Harbor, RLlib, Gymnasium, Farama Foundation, and CleanRL for agent training, evaluation, and environments.

  17. March 16, 2026

    Top 5 Reinforcement Learning Environments

    A comprehensive guide to the best reinforcement learning environment tools in 2026. Compare HUD, Gymnasium, RLlib, CleanRL, and Prime Intellect across standardization, reproducibility, benchmarking, and more.

Build environments that frontier labs trust

Create your first environment in minutes. No credit card required.

Anything you can simulate and grade, you can improve.

GitHubXDiscord
Product
  • Evaluations(opens in new tab)
  • Environments
  • DataVendor(opens in new tab)
Resources
  • Documentation(opens in new tab)
  • Blog
  • Research
  • Guides
Company
  • Careers30
  • Contact
© 2026 Human Union Data, Inc.
PrivacyTermsTrust(opens in new tab)