GPU version is needed!

[TITONIChen]

Hi,

Thanks for reading my issue. I've learned from your amazing paper named The Power of Scale for Parameter-Efficient Prompt Tuning. I'm wondering whether I could train my prompt-based model with GPU on my PC, or must via Google Cloud TPU. In other words, could you please provide me with another version of codes which is only relied on GPU?

Looking forward to your reply!
Thanks

Chen

[blester125]

Hi!

This code base uses T5X for training and inference on accelerators. Based on the note here https://github.com/google-research/t5x#installation T5X should work on GPUs. I'm not sure if it will automatically detect and use GPUs or if there is some flag that needs to be set.

Hope that helps!

[hepengfe]

I have tried the code on GPU and it's working. However, the cuda driver/toolkit and package setup takes some time.