Usage Example
Here's a Python code snippet demonstrating how to interact with the Medical-Llama3-8B-16bit model and generate answers to your medical questions:
Medical-Llama3-8B-16bit
python3 examples/inference.py --model_name_or_path=./