Issues

• 为什么我的地址都改了，还会出现这样的错误：Traceback (most recent call last): File "/root/autodl-tmp/model/XrayGLM/VisualGLM-6B-main/finetune_visualglm.py", line 9, in <module> from sat.model.finetune.lora2 import LoraMixin ModuleNotFoundError: No module named 'sat.model.finetune.lora2' [2024-12-25 00:31:28,139] [INFO] [launch.py:319:sigkill_handler] Killing subprocess 1338

  THUDM/SwissArmyTransformer#188 · Filter by author zxdpro opened on Dec 24, 2024

• ImportError: cannot import name 'rotate_half' from 'sat.model.official.llama_model'

  THUDM/SwissArmyTransformer#187 · Filter by author kkkwjr opened on Dec 4, 2024

• UnboundLocalError: local variable 'batch_size' referenced before assignment

  THUDM/SwissArmyTransformer#186 · Filter by author Money8888 opened on Nov 25, 2024
  1

• MetaDistributedWebDataset传入的训练数据格式是否有范例参考？

  THUDM/SwissArmyTransformer#185 · Filter by author xiabaoyulo opened on Sep 14, 2024

• 在使用Deepspeed的zero stage2训练visualglm-6B是，出现最终权重为25G的现象

  THUDM/SwissArmyTransformer#182 · Filter by author corkiyao opened on Sep 9, 2024

• ema模型是否正确被保存

  THUDM/SwissArmyTransformer#180 · Filter by author Blueskyvvvvv opened on Aug 10, 2024
  1

• TypeError: sat.model.transformer.BaseTransformer() got multiple values for keyword argument 'parallel_output'

  THUDM/SwissArmyTransformer#179 · Filter by author deep-practice opened on Jul 26, 2024
  35

• 请问断点续训应该如何设置

  THUDM/SwissArmyTransformer#178 · Filter by author elesun2018 opened on Apr 11, 2024
  6

• transfer_param.py 转换vincuna hf模型成sat模型报错

  THUDM/SwissArmyTransformer#177 · Filter by author Lunatic-Solar opened on Apr 8, 2024
  17

• NO cogagent？

  THUDM/SwissArmyTransformer#175 · Filter by author Mac0q opened on Mar 22, 2024
  2

• ModuleNotFoundError: No module named 'localAttention'

  THUDM/SwissArmyTransformer#174 · Filter by author BlueSkyyyyyy opened on Mar 20, 2024

• “No backend type associated with device type cpu” when run cli_demo_sat.py

  THUDM/SwissArmyTransformer#173 · Filter by author yileld opened on Mar 5, 2024
  5

• 如果想绕过deepspeed做finetune，可以在train的时候直接model.step()来实现吗？

  THUDM/SwissArmyTransformer#172 · Filter by author cocoshe opened on Feb 16, 2024
  2

• MixtralMlpMixin()这个函数里面moe只是计算专家的logits但是没看到分发逻辑

  THUDM/SwissArmyTransformer#170 · Filter by author AlenjandroWang opened on Feb 9, 2024
  1

• AutoModel.from_pretrained()里面不能加载hf版本的权重吗

  THUDM/SwissArmyTransformer#169 · Filter by author AlenjandroWang opened on Feb 4, 2024
  1

• 怎么从断点恢复微调训练

  THUDM/SwissArmyTransformer#167 · Filter by author zoumaguanxin opened on Feb 2, 2024
  1

• deepspeed 分布式训练 loss nan or inf

  THUDM/SwissArmyTransformer#161 · Filter by author JohnTang93 opened on Jan 19, 2024
  1

• Is sat suuport saving checkpoint by using fp16 or bf16?

  THUDM/SwissArmyTransformer#160 · Filter by author xxxwuwq opened on Jan 19, 2024
  5

• deepspeed分布式训练出现sat ValueError inconsistent

  THUDM/SwissArmyTransformer#149 · Filter by author elesun2018 opened on Dec 14, 2023
  1

• How to embed video encoder module from pytorch？

  THUDM/SwissArmyTransformer#148 · Filter by author zyhzyh88 opened on Dec 4, 2023
  3

• ore.exceptions.ResponseStreamingError

  THUDM/SwissArmyTransformer#142 · Filter by author AnnaYang2020 opened on Nov 1, 2023
  1

• Cannot use torch.compile with SAT

  THUDM/SwissArmyTransformer#141 · Filter by author lijing1996 opened on Oct 23, 2023

• Fail to load random states from checkpoints saved

  THUDM/SwissArmyTransformer#137 · Filter by author minkowski0125 opened on Sep 25, 2023
  2

• ModuleNotFoundError: No module named 'SwissArmyTransformer'

  THUDM/SwissArmyTransformer#133 · Filter by author B-1368 opened on Sep 9, 2023
  6

• 请教一个问题，使用mp_size=2时的loss应该怎么写

  THUDM/SwissArmyTransformer#131 · Filter by author kunden0612 opened on Aug 24, 2023
  1