Search results

Exception for “ttft” in the run result

Status: Open.

#130 In flexflow/flexflow-serve;

· 2065037421 opened on Apr 28, 2025

Error when using multiple SSMs: Assertion 'input_trees.size() == 1 && "currently using one ssm"' failed

Status: Open.

#120 In flexflow/flexflow-serve;

· bowgeem opened on Mar 27, 2025

Build failure: undefined reference to `__fs_log_1'

bugSomething isn't workingSomething isn't working

Status: Open.

#88 In flexflow/flexflow-serve;

· suranap opened on Jan 7, 2025

Hash function doesn't hash

bugSomething isn't workingSomething isn't working

Status: Open.

#89 In flexflow/flexflow-serve;

· suranap opened on Dec 14, 2024

Unable to use ./inference/incr_decoding/incr_decoding on inference branch

Status: Open.

#1 In flexflow/flexflow-serve;

· hugolatendresse opened on Nov 26, 2024

How to enable support for larger sequence lengths?

Status: Open.

#2 In flexflow/flexflow-serve;

· QAZWSX0827 opened on Nov 22, 2024

Performance issue when batch_size is 32

Status: Open.

#3 In flexflow/flexflow-serve;

· letheantest opened on Oct 22, 2024

Stuck During Tree-Based Speculative Decoding with OPT Model

Status: Open.

#4 In flexflow/flexflow-serve;

· SeungjaeLim opened on Oct 16, 2024

cuIpcGetMemHandle triggered CUDA out of memory when I use flexflow on one gpu

Status: Open.

#75 In flexflow/flexflow-serve;

· spacecat2002 opened on Sep 11, 2024

Error when I use larger batch size for spec-infer

Status: Open.

#6 In flexflow/flexflow-serve;

· lhr-30 opened on Sep 6, 2024

Issue with C++ inference for model meta-llama/Llama-2-70b-hf

Status: Open.

#5 In flexflow/flexflow-serve;

· DDDDDYTS opened on Jul 24, 2024

Request for Graph Pruning Algorithm Code Location in FlexLLM

Status: Open.

#7 In flexflow/flexflow-serve;

· zbtrs opened on Jun 26, 2024