ML Engineering
    • Repository
    • Source Code
    • New Issue
  1. 📦 Storage
  2. Benchmarks
  3. Results
  4. fio benchmark results for hope on 2023-12-20-14:37:02
  • 📓 Resources
  • ✏️ Testing
  • 🤗 Transformers
  • 💻 Compute
    • CPU memory
    • CPU
    • Accelerators
      • Nvidia
        • Troubleshooting NVIDIA GPUs
  • 🐛 Debugging
    • A Back up of scripts
    • Faster debug and development with tiny models, tokenizers and datasets
    • NCCL: Debug and Performance
    • Debugging PyTorch programs
    • Debug Tools
    • Diagnosing Hangings and Deadlocks in Multi-Node Multi-GPU Python Programs
    • Underflow and Overflow Detection
  • 🧠 Insights
    • 🪖 The AI Battlefield
  • 🛜 Networking
    • Networking Benchmarks
      • Network Benchmarks Results
        • Disabling NVLink Benchmark
  • 🎻 Orchestration
    • Working in SLURM Environment
      • SLURM Administration
      • Launchers with SLURM
      • SLURM Performance
      • SLURM for users
  • 📦 Storage
    • Benchmarks
      • Results
        • fio benchmark results for hope on 2023-12-20-14:37:02
  • 🏋️ Training
    • Tensor precision / Data types
    • Emulate a multi-node setup using just a single node
    • Selecting Training Hyper-Parameters And Model Initializations
    • Checkpoints
    • Fault Tolerance
    • Model Parallelism
    • Software Tune Up For The Best Performance
    • Reproducibility
    • Re-train HF Hub Models From Scratch Using Finetuning Examples
    • Avoiding, Recovering From and Understanding Instabilities
      • Understanding Training Loss Patterns

On this page

  • fio benchmark results for hope on 2023-12-20-14:37:02
  • View source
  • Edit this page
  • Report an issue

Other Formats

  • Github (GFM)
  1. 📦 Storage
  2. Benchmarks
  3. Results
  4. fio benchmark results for hope on 2023-12-20-14:37:02

February 20, 2024

fio benchmark results for hope on 2023-12-20-14:37:02

partition /mnt/nvme0/fio/fio-test

  • filesize=16k read
lat msec bw MBps IOPS jobs
4.0 1006.3 257614 16
  • filesize=16k write
lat msec bw MBps IOPS jobs
3.2 1239.1 317200 16
  • filesize=1m read
lat msec bw MBps IOPS jobs
1.7 2400.1 614419 16
  • filesize=1m write
lat msec bw MBps IOPS jobs
2.1 1940.5 496765 16
  • filesize=1g read
lat msec bw MBps IOPS jobs
1.4 2762.0 707062 16
  • filesize=1g write
lat msec bw MBps IOPS jobs
2.1 1943.9 497638 16
Back to top

Citation

BibTeX citation:
@online{bekman2024,
  author = {Bekman, Stas and Foreman, Sam},
  title = {ML {Engineering}},
  date = {2024-02-20},
  url = {https://saforem2.github.io/ml-engineering},
  langid = {en}
}
For attribution, please cite this work as:
Bekman, Stas, and Sam Foreman. 2024. “ML Engineering.” February 20, 2024. https://saforem2.github.io/ml-engineering.
📦 Storage
🏋️ Training

ML-Engineering

2024

  • View source
  • Edit this page
  • Report an issue