Deep learning researcher. Making large language models more accessible with Petals: https://petals.ml
- Yerevan, Armenia
- @sasha_borzunov
Block or Report
Block or report borzunov
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePinned
-
bigscience-workshop/petals Public
🌸 Run large language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading -
learning-at-home/hivemind Public
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
-
cpmoptimize Public
🚀 🐍 Optimizes Python bytecode calculating linear recurrences, reducing the time complexity from O(n) to O(log n) -
874 contributions in the last year
Day of Week | July Jul | August Aug | September Sep | October Oct | November Nov | December Dec | January Jan | February Feb | March Mar | April Apr | May May | June Jun | July Jul | ||||||||||||||||||||||||||||||||||||||||
Sunday Sun | No contributions on Sunday, July 17, 2022 | No contributions on Sunday, July 24, 2022 | No contributions on Sunday, July 31, 2022 | 3 contributions on Sunday, August 7, 2022 | No contributions on Sunday, August 14, 2022 | No contributions on Sunday, August 21, 2022 | No contributions on Sunday, August 28, 2022 | 1 contribution on Sunday, September 4, 2022 | No contributions on Sunday, September 11, 2022 | No contributions on Sunday, September 18, 2022 | No contributions on Sunday, September 25, 2022 | No contributions on Sunday, October 2, 2022 | No contributions on Sunday, October 9, 2022 | No contributions on Sunday, October 16, 2022 | No contributions on Sunday, October 23, 2022 | No contributions on Sunday, October 30, 2022 | No contributions on Sunday, November 6, 2022 | No contributions on Sunday, November 13, 2022 | No contributions on Sunday, November 20, 2022 | 10 contributions on Sunday, November 27, 2022 | 6 contributions on Sunday, December 4, 2022 | No contributions on Sunday, December 11, 2022 | No contributions on Sunday, December 18, 2022 | No contributions on Sunday, December 25, 2022 | No contributions on Sunday, January 1, 2023 | 13 contributions on Sunday, January 8, 2023 | 2 contributions on Sunday, January 15, 2023 | 8 contributions on Sunday, January 22, 2023 | No contributions on Sunday, January 29, 2023 | 1 contribution on Sunday, February 5, 2023 | No contributions on Sunday, February 12, 2023 | 10 contributions on Sunday, February 19, 2023 | 4 contributions on Sunday, February 26, 2023 | No contributions on Sunday, March 5, 2023 | 4 contributions on Sunday, March 12, 2023 | No contributions on Sunday, March 19, 2023 | No contributions on Sunday, March 26, 2023 | No contributions on Sunday, April 2, 2023 | No contributions on Sunday, April 9, 2023 | No contributions on Sunday, April 16, 2023 | No contributions on Sunday, April 23, 2023 | No contributions on Sunday, April 30, 2023 | 4 contributions on Sunday, May 7, 2023 | No contributions on Sunday, May 14, 2023 | No contributions on Sunday, May 21, 2023 | No contributions on Sunday, May 28, 2023 | No contributions on Sunday, June 4, 2023 | No contributions on Sunday, June 11, 2023 | No contributions on Sunday, June 18, 2023 | No contributions on Sunday, June 25, 2023 | 4 contributions on Sunday, July 2, 2023 | No contributions on Sunday, July 9, 2023 | 6 contributions on Sunday, July 16, 2023 |
Monday Mon | No contributions on Monday, July 18, 2022 | No contributions on Monday, July 25, 2022 | No contributions on Monday, August 1, 2022 | No contributions on Monday, August 8, 2022 | 1 contribution on Monday, August 15, 2022 | No contributions on Monday, August 22, 2022 | 4 contributions on Monday, August 29, 2022 | 5 contributions on Monday, September 5, 2022 | No contributions on Monday, September 12, 2022 | 1 contribution on Monday, September 19, 2022 | No contributions on Monday, September 26, 2022 | No contributions on Monday, October 3, 2022 | No contributions on Monday, October 10, 2022 | No contributions on Monday, October 17, 2022 | No contributions on Monday, October 24, 2022 | No contributions on Monday, October 31, 2022 | 1 contribution on Monday, November 7, 2022 | No contributions on Monday, November 14, 2022 | 1 contribution on Monday, November 21, 2022 | 11 contributions on Monday, November 28, 2022 | 6 contributions on Monday, December 5, 2022 | 4 contributions on Monday, December 12, 2022 | 2 contributions on Monday, December 19, 2022 | No contributions on Monday, December 26, 2022 | 3 contributions on Monday, January 2, 2023 | 8 contributions on Monday, January 9, 2023 | 13 contributions on Monday, January 16, 2023 | 2 contributions on Monday, January 23, 2023 | 1 contribution on Monday, January 30, 2023 | 4 contributions on Monday, February 6, 2023 | No contributions on Monday, February 13, 2023 | No contributions on Monday, February 20, 2023 | 2 contributions on Monday, February 27, 2023 | No contributions on Monday, March 6, 2023 | 3 contributions on Monday, March 13, 2023 | No contributions on Monday, March 20, 2023 | No contributions on Monday, March 27, 2023 | No contributions on Monday, April 3, 2023 | No contributions on Monday, April 10, 2023 | No contributions on Monday, April 17, 2023 | 2 contributions on Monday, April 24, 2023 | No contributions on Monday, May 1, 2023 | No contributions on Monday, May 8, 2023 | 1 contribution on Monday, May 15, 2023 | No contributions on Monday, May 22, 2023 | 4 contributions on Monday, May 29, 2023 | No contributions on Monday, June 5, 2023 | 1 contribution on Monday, June 12, 2023 | No contributions on Monday, June 19, 2023 | No contributions on Monday, June 26, 2023 | 2 contributions on Monday, July 3, 2023 | 1 contribution on Monday, July 10, 2023 | 5 contributions on Monday, July 17, 2023 |
Tuesday Tue | No contributions on Tuesday, July 19, 2022 | No contributions on Tuesday, July 26, 2022 | 2 contributions on Tuesday, August 2, 2022 | 6 contributions on Tuesday, August 9, 2022 | 2 contributions on Tuesday, August 16, 2022 | 3 contributions on Tuesday, August 23, 2022 | 1 contribution on Tuesday, August 30, 2022 | No contributions on Tuesday, September 6, 2022 | No contributions on Tuesday, September 13, 2022 | 3 contributions on Tuesday, September 20, 2022 | No contributions on Tuesday, September 27, 2022 | 1 contribution on Tuesday, October 4, 2022 | 3 contributions on Tuesday, October 11, 2022 | No contributions on Tuesday, October 18, 2022 | No contributions on Tuesday, October 25, 2022 | 8 contributions on Tuesday, November 1, 2022 | No contributions on Tuesday, November 8, 2022 | No contributions on Tuesday, November 15, 2022 | No contributions on Tuesday, November 22, 2022 | 9 contributions on Tuesday, November 29, 2022 | 4 contributions on Tuesday, December 6, 2022 | 7 contributions on Tuesday, December 13, 2022 | No contributions on Tuesday, December 20, 2022 | 6 contributions on Tuesday, December 27, 2022 | 5 contributions on Tuesday, January 3, 2023 | 7 contributions on Tuesday, January 10, 2023 | 10 contributions on Tuesday, January 17, 2023 | 3 contributions on Tuesday, January 24, 2023 | 4 contributions on Tuesday, January 31, 2023 | 3 contributions on Tuesday, February 7, 2023 | 1 contribution on Tuesday, February 14, 2023 | 3 contributions on Tuesday, February 21, 2023 | No contributions on Tuesday, February 28, 2023 | No contributions on Tuesday, March 7, 2023 | No contributions on Tuesday, March 14, 2023 | No contributions on Tuesday, March 21, 2023 | 4 contributions on Tuesday, March 28, 2023 | 1 contribution on Tuesday, April 4, 2023 | No contributions on Tuesday, April 11, 2023 | No contributions on Tuesday, April 18, 2023 | 4 contributions on Tuesday, April 25, 2023 | No contributions on Tuesday, May 2, 2023 | 6 contributions on Tuesday, May 9, 2023 | No contributions on Tuesday, May 16, 2023 | No contributions on Tuesday, May 23, 2023 | No contributions on Tuesday, May 30, 2023 | No contributions on Tuesday, June 6, 2023 | No contributions on Tuesday, June 13, 2023 | No contributions on Tuesday, June 20, 2023 | No contributions on Tuesday, June 27, 2023 | No contributions on Tuesday, July 4, 2023 | 12 contributions on Tuesday, July 11, 2023 | 10 contributions on Tuesday, July 18, 2023 |
Wednesday Wed | 2 contributions on Wednesday, July 20, 2022 | No contributions on Wednesday, July 27, 2022 | No contributions on Wednesday, August 3, 2022 | 15 contributions on Wednesday, August 10, 2022 | 2 contributions on Wednesday, August 17, 2022 | No contributions on Wednesday, August 24, 2022 | 6 contributions on Wednesday, August 31, 2022 | 1 contribution on Wednesday, September 7, 2022 | No contributions on Wednesday, September 14, 2022 | No contributions on Wednesday, September 21, 2022 | No contributions on Wednesday, September 28, 2022 | No contributions on Wednesday, October 5, 2022 | 2 contributions on Wednesday, October 12, 2022 | No contributions on Wednesday, October 19, 2022 | 2 contributions on Wednesday, October 26, 2022 | 4 contributions on Wednesday, November 2, 2022 | No contributions on Wednesday, November 9, 2022 | No contributions on Wednesday, November 16, 2022 | No contributions on Wednesday, November 23, 2022 | 12 contributions on Wednesday, November 30, 2022 | 2 contributions on Wednesday, December 7, 2022 | 4 contributions on Wednesday, December 14, 2022 | 2 contributions on Wednesday, December 21, 2022 | 11 contributions on Wednesday, December 28, 2022 | 18 contributions on Wednesday, January 4, 2023 | 18 contributions on Wednesday, January 11, 2023 | 5 contributions on Wednesday, January 18, 2023 | No contributions on Wednesday, January 25, 2023 | No contributions on Wednesday, February 1, 2023 | No contributions on Wednesday, February 8, 2023 | No contributions on Wednesday, February 15, 2023 | No contributions on Wednesday, February 22, 2023 | 6 contributions on Wednesday, March 1, 2023 | 1 contribution on Wednesday, March 8, 2023 | 2 contributions on Wednesday, March 15, 2023 | No contributions on Wednesday, March 22, 2023 | 10 contributions on Wednesday, March 29, 2023 | No contributions on Wednesday, April 5, 2023 | 5 contributions on Wednesday, April 12, 2023 | No contributions on Wednesday, April 19, 2023 | 2 contributions on Wednesday, April 26, 2023 | No contributions on Wednesday, May 3, 2023 | 3 contributions on Wednesday, May 10, 2023 | No contributions on Wednesday, May 17, 2023 | No contributions on Wednesday, May 24, 2023 | No contributions on Wednesday, May 31, 2023 | No contributions on Wednesday, June 7, 2023 | No contributions on Wednesday, June 14, 2023 | No contributions on Wednesday, June 21, 2023 | No contributions on Wednesday, June 28, 2023 | 3 contributions on Wednesday, July 5, 2023 | 18 contributions on Wednesday, July 12, 2023 | 30 contributions on Wednesday, July 19, 2023 |
Thursday Thu | No contributions on Thursday, July 21, 2022 | No contributions on Thursday, July 28, 2022 | No contributions on Thursday, August 4, 2022 | 19 contributions on Thursday, August 11, 2022 | 2 contributions on Thursday, August 18, 2022 | No contributions on Thursday, August 25, 2022 | 12 contributions on Thursday, September 1, 2022 | No contributions on Thursday, September 8, 2022 | No contributions on Thursday, September 15, 2022 | No contributions on Thursday, September 22, 2022 | No contributions on Thursday, September 29, 2022 | No contributions on Thursday, October 6, 2022 | No contributions on Thursday, October 13, 2022 | No contributions on Thursday, October 20, 2022 | No contributions on Thursday, October 27, 2022 | No contributions on Thursday, November 3, 2022 | No contributions on Thursday, November 10, 2022 | No contributions on Thursday, November 17, 2022 | 3 contributions on Thursday, November 24, 2022 | 7 contributions on Thursday, December 1, 2022 | 14 contributions on Thursday, December 8, 2022 | 9 contributions on Thursday, December 15, 2022 | 2 contributions on Thursday, December 22, 2022 | 4 contributions on Thursday, December 29, 2022 | 8 contributions on Thursday, January 5, 2023 | 4 contributions on Thursday, January 12, 2023 | No contributions on Thursday, January 19, 2023 | No contributions on Thursday, January 26, 2023 | No contributions on Thursday, February 2, 2023 | 2 contributions on Thursday, February 9, 2023 | 2 contributions on Thursday, February 16, 2023 | No contributions on Thursday, February 23, 2023 | 2 contributions on Thursday, March 2, 2023 | No contributions on Thursday, March 9, 2023 | 1 contribution on Thursday, March 16, 2023 | No contributions on Thursday, March 23, 2023 | 4 contributions on Thursday, March 30, 2023 | No contributions on Thursday, April 6, 2023 | 6 contributions on Thursday, April 13, 2023 | No contributions on Thursday, April 20, 2023 | 4 contributions on Thursday, April 27, 2023 | No contributions on Thursday, May 4, 2023 | No contributions on Thursday, May 11, 2023 | No contributions on Thursday, May 18, 2023 | 1 contribution on Thursday, May 25, 2023 | No contributions on Thursday, June 1, 2023 | 2 contributions on Thursday, June 8, 2023 | 1 contribution on Thursday, June 15, 2023 | No contributions on Thursday, June 22, 2023 | 3 contributions on Thursday, June 29, 2023 | No contributions on Thursday, July 6, 2023 | 6 contributions on Thursday, July 13, 2023 | |
Friday Fri | 1 contribution on Friday, July 22, 2022 | No contributions on Friday, July 29, 2022 | No contributions on Friday, August 5, 2022 | No contributions on Friday, August 12, 2022 | 2 contributions on Friday, August 19, 2022 | 5 contributions on Friday, August 26, 2022 | 5 contributions on Friday, September 2, 2022 | No contributions on Friday, September 9, 2022 | No contributions on Friday, September 16, 2022 | No contributions on Friday, September 23, 2022 | No contributions on Friday, September 30, 2022 | No contributions on Friday, October 7, 2022 | No contributions on Friday, October 14, 2022 | No contributions on Friday, October 21, 2022 | No contributions on Friday, October 28, 2022 | No contributions on Friday, November 4, 2022 | No contributions on Friday, November 11, 2022 | No contributions on Friday, November 18, 2022 | 4 contributions on Friday, November 25, 2022 | 23 contributions on Friday, December 2, 2022 | 13 contributions on Friday, December 9, 2022 | 6 contributions on Friday, December 16, 2022 | 2 contributions on Friday, December 23, 2022 | 14 contributions on Friday, December 30, 2022 | 7 contributions on Friday, January 6, 2023 | 25 contributions on Friday, January 13, 2023 | 1 contribution on Friday, January 20, 2023 | No contributions on Friday, January 27, 2023 | 2 contributions on Friday, February 3, 2023 | No contributions on Friday, February 10, 2023 | 3 contributions on Friday, February 17, 2023 | No contributions on Friday, February 24, 2023 | 2 contributions on Friday, March 3, 2023 | 1 contribution on Friday, March 10, 2023 | No contributions on Friday, March 17, 2023 | No contributions on Friday, March 24, 2023 | 6 contributions on Friday, March 31, 2023 | No contributions on Friday, April 7, 2023 | 1 contribution on Friday, April 14, 2023 | 1 contribution on Friday, April 21, 2023 | No contributions on Friday, April 28, 2023 | No contributions on Friday, May 5, 2023 | No contributions on Friday, May 12, 2023 | No contributions on Friday, May 19, 2023 | 2 contributions on Friday, May 26, 2023 | No contributions on Friday, June 2, 2023 | No contributions on Friday, June 9, 2023 | No contributions on Friday, June 16, 2023 | 7 contributions on Friday, June 23, 2023 | 4 contributions on Friday, June 30, 2023 | No contributions on Friday, July 7, 2023 | 21 contributions on Friday, July 14, 2023 | |
Saturday Sat | No contributions on Saturday, July 23, 2022 | No contributions on Saturday, July 30, 2022 | 28 contributions on Saturday, August 6, 2022 | 3 contributions on Saturday, August 13, 2022 | No contributions on Saturday, August 20, 2022 | 4 contributions on Saturday, August 27, 2022 | 5 contributions on Saturday, September 3, 2022 | No contributions on Saturday, September 10, 2022 | No contributions on Saturday, September 17, 2022 | No contributions on Saturday, September 24, 2022 | No contributions on Saturday, October 1, 2022 | 5 contributions on Saturday, October 8, 2022 | No contributions on Saturday, October 15, 2022 | No contributions on Saturday, October 22, 2022 | No contributions on Saturday, October 29, 2022 | No contributions on Saturday, November 5, 2022 | No contributions on Saturday, November 12, 2022 | No contributions on Saturday, November 19, 2022 | 4 contributions on Saturday, November 26, 2022 | 27 contributions on Saturday, December 3, 2022 | 1 contribution on Saturday, December 10, 2022 | No contributions on Saturday, December 17, 2022 | No contributions on Saturday, December 24, 2022 | 4 contributions on Saturday, December 31, 2022 | 4 contributions on Saturday, January 7, 2023 | 2 contributions on Saturday, January 14, 2023 | 2 contributions on Saturday, January 21, 2023 | No contributions on Saturday, January 28, 2023 | No contributions on Saturday, February 4, 2023 | No contributions on Saturday, February 11, 2023 | No contributions on Saturday, February 18, 2023 | No contributions on Saturday, February 25, 2023 | No contributions on Saturday, March 4, 2023 | 1 contribution on Saturday, March 11, 2023 | No contributions on Saturday, March 18, 2023 | No contributions on Saturday, March 25, 2023 | No contributions on Saturday, April 1, 2023 | No contributions on Saturday, April 8, 2023 | No contributions on Saturday, April 15, 2023 | No contributions on Saturday, April 22, 2023 | No contributions on Saturday, April 29, 2023 | No contributions on Saturday, May 6, 2023 | No contributions on Saturday, May 13, 2023 | No contributions on Saturday, May 20, 2023 | No contributions on Saturday, May 27, 2023 | No contributions on Saturday, June 3, 2023 | 1 contribution on Saturday, June 10, 2023 | 1 contribution on Saturday, June 17, 2023 | 5 contributions on Saturday, June 24, 2023 | 1 contribution on Saturday, July 1, 2023 | No contributions on Saturday, July 8, 2023 | 22 contributions on Saturday, July 15, 2023 |
Less
More
Contribution activity
July 2023
Created 93 commits in 5 repositories
Created a pull request in bigscience-workshop/petals that received 4 comments
Use bnb==0.40.0.post4 to fix bias bug, use bfloat16 by default
This PR: Includes a bnb hotfix: TimDettmers/bitsandbytes@90b0ac5 Changes the default llama dtype to bfloat16 to be compatible with guanaco.
+13
−6
•
4
comments
Opened 31 other pull requests in 4 repositories
bigscience-workshop/petals
27
merged
- Bump version to 2.0.0.post1
- Require accelerate>=0.20.3 as transformers do
- Support Llama 2
- Fix --token arg
- Fix readme code example, require Python < 3.11 until supported
- Update transformers to 4.31.0 and peft to 0.4.0
- Fix AssertionError on rebalancing
- Require transformers < 4.31.0 until we're compatible
- Update readme to show new models
- Implement shortest-path routing for inference
- Update readme and "Getting started" link
- Report inference, forward, and network RPS separately
- Use bitsandbytes 0.40.1.post1
- Make a server ping next servers
- Share more info about a server in DHT
- Fix bugs in _choose_num_blocks() added in #346
- Test that bitsandbytes is not imported when it's not used
- Spam less in server logs
- Support LLaMA repos without "-hf" suffix
- Fix Docker build by avoiding Python 3.11
- Import petals.utils.peft only when needed to avoid unnecessary import of bitsandbytes
- Mention LLaMA in readme
- Use bitsandbytes 0.40.0.post4 with bias hotfix
- Use 4-bit for llama by default, use bitsandbytes 0.40.0.post3
- Allow free_disk_space_for() remove arbitrary files from Petals cache
- Some pull requests not shown.
learning-at-home/hivemind
1
open
1
merged
petals-infra/health.petals.ml
1
merged
petals-infra/chat.petals.ml
1
merged
Reviewed 13 pull requests in 1 repository
bigscience-workshop/petals
13 pull requests
- Inherit bitsandbytes compute dtype correctly (override peft quirk)
- Fix handler memory leak, get rid of mp.Manager
- Implement shortest-path routing for inference
- Report inference, forward, and network RPS separately
- Make a server ping next servers
- Switch adapters slightly faster
- Fix bugs in _choose_num_blocks() added in #346
- Test that bitsandbytes is not imported when it's not used
- Remove unused import os
- Estimate adapter memory overhead in choose_num_blocks()
- Support peft LoRA adapters
- Implement direct server-to-server communication
- Allow free_disk_space_for() remove arbitrary files from Petals cache