Calculate the GPU memory required for a given context window length. Accounts for KV-cache, attention scores, and activation memory as sequence length scales.
Enter the values for the patient or scenario you are assessing. Calculate the GPU memory required for a given context window length. Accounts for KV-cache, attention scores, and activation memory as sequence length scales. Use the context memory result to inform your clinical assessment.