As title, this will help if, when we need to wrap self.wte with FSDP
self.wte
Need https://huggingface.co/mosaicml/mpt-7b/discussions/56
· Sign up or log in to comment