hf_mirrors/llm-jp-13b-v2.0
Model Introduction
Files & versions
Analysis
You are visiting the mirror address of https://modelers.cn/wuhaicc/llm-jp-13b-v2.0. The repo is synchronized in real-time and is only for mirror acceleration access.

llm-jp-13b-v2.0

Required Libraries and Their Versions

  • torch>=2.3.0
  • transformers>=4.40.1
  • tokenizers>=0.19.1
  • accelerate>=0.29.3
  • flash-attn>=2.5.8

Usage

python3 examples/inference.py --model_name_or_path=./

Model Details

  • Model type: Transformer-based Language Model
  • Total seen tokens: 256B
ModelParamsLayersHidden sizeHeadsContext length
13b model13b405120404096

Risks and Limitations

The models released here are still in the early stages of our research and development and have not been tuned to ensure outputs align with human intent and safety considerations.

Send Questions to

llm-jp(at)nii.ac.jp

Model Card Authors

The names are listed in alphabetical order.

Namgi Han, Tatsuya Hiraoka, Hirokazu Kiyomaru, Takashi Kodama, and Hiroshi Matsuda.