All pull requests

Pull requests

• fix: replace 2 bare except clauses with except Exception

  #628·haosenwang1018 opened Feb 26, 2026·

  ·

• Add instructions to README.md for including HuggingFace access token

  #619·jhancock1975 opened Jan 1, 2025·

  ·

• Enhance Logging in RemoteGenerationMixin for Better Debugging

  #612·mandlinsarah opened Sep 4, 2024·

  ·

• Enhance Speculative Generation with Better Type Hints and Cleaner Code

  #611·mandlinsarah opened Aug 30, 2024·

  ·

• Allow serving llama models with tensor parallel

  #592·Jackmin801 opened Jul 20, 2024·

  ·
  2

• draft test

  #591·xtinkt opened Jul 18, 2024·

  ·

• Speculative inference

  #590·xtinkt opened Jul 18, 2024·

  ·

• Direct server-to-server communication during finetuning

  #560·dvmazur opened Mar 9, 2024·

  ·

• Fix push-docker-image's "No space left on device"

  #555·dvmazur opened Feb 17, 2024·

  ·

• Example of agents usage with Petals

  #547·RomaA2000 opened Dec 11, 2023·

  ·

• replaced call to _prepare_decoder_attention_mask() with _prepare_4d_causal_attention_mask()

  #545·poedator opened Nov 21, 2023·

  ·
  1

• install script to help the project deployment or for easy use

  #544·elsolo5000-2 opened Nov 16, 2023·

  ·

• Fix retries during inference

  #523·borzunov opened Sep 28, 2023·

  ·
  1

• Add loading LoRA adapters from clients' requests

  #506·artek0chumak opened Sep 6, 2023·

  ·

• Remove smaller limit for legacy bfloat16 serialization

  #505·borzunov opened Sep 5, 2023·

  ·

• Llama: Merge query/key/value projection layers

  #498·mryab opened Sep 2, 2023·

  ·

• mitigate unnecessary swarm rebalancing

  #493·iateadonut opened Aug 31, 2023·

  ·

• Forward arbitrary kwargs to remote blocks

  #467·justheuristic opened Aug 17, 2023·

  ·
  6

• Update install instructions to cuda 11.8

  #438·vadi2 opened Aug 6, 2023·

  ·
  3

• Support saving and loading 8-bit block weights

  #273·mryab opened Feb 25, 2023·

  ·
  8