🔄 In a Training Loop

Ramshreyas Rao PRO

EXDai

1

·

AI & ML interests

Post training, fine-tuning, quantization, distillation, pruning, SLMs, Local AI

Recent Activity

published an article 11 days ago

Attention in Qwen3.6-35B-A3B

updated a dataset 11 days ago

EXDai/attention-mechanism

published a dataset 12 days ago

EXDai/attention-mechanism

View all activity

Organizations

Articles 8

Article

Attention in Qwen3.6-35B-A3B

Article

Q, K and V

View all Articles

spaces 4

Qwen3 Architecture

Explore the Qwen 3.6‑35B model architecture

Speculative Decoding Simulator

LLM Inference Simulator — Extended

LLM Inference Pipeline Simulator

models 0

None public yet

datasets 8

EXDai/attention-mechanism

Viewer • Updated 11 days ago • 11 • 287

EXDai/qkv-projection

Viewer • Updated Jul 27 • 10 • 277

EXDai/linear-algebra-transformers

Viewer • Updated Jul 22 • 6 • 118

EXDai/mrope-exploration

Updated Jul 12 • 29

EXDai/episode-08-positional-embeddings

Viewer • Updated Jun 26 • 1 • 16

EXDai/episode-07-tokenization

Updated Jun 26 • 13

EXDai/vllm-configs

Updated Jun 26 • 500

EXDai/benchmark-results

Viewer • Updated Jun 26 • 35 • 8