Huggingfacae TGI ERROR text_generation_launcher: Shard 0 failed to start
2024-05-02T17:06:59.807336Z INFO download: text_generation_launcher: Successfully downloaded weights.
2024-05-02T17:06:59.807762Z INFO shard-manager: text_generation_launcher: Starting shard rank=0
2024-05-02T17:07:02.879107Z WARN text_generation_launcher: Could not import Flash Attention enabled models: CUDA is not available