Commit History

  1. Delete pytorch_model.bin.index.json

    715560b
  2. Update modeling_alinlight.py

    59dea23

  1. Update modeling_alinlight.py

    cc355cb
  2. Upload checkpoint 2000 (Testing GatedNorm initialization)

    c1334f9

  1. Update modeling_alinlight.py

    4e82db0

  1. Update modeling_alinlight.py

    356d8c9
  2. Update modeling_alinlight.py

    7e1f9ec
  3. Update modeling_alinlight.py

    1b90c70

  1. Update configuration_alinlight.py

    7c142f9
  2. Update modeling_alinlight.py

    74fd873

  1. Update modeling_alinlight.py

    c290251
  2. Update modeling_alinlight.py

    59bdbc7
  3. Update modeling_alinlight.py

    f4722b6
  4. FIX ATTENTION

    4c21e6f

  1. Step 300

    9fb53e9

  1. Step Final_Loss6.35_Tok19.69M

    8a48e52
  2. Upload config.json with huggingface_hub

    2696785
  3. Step 1000

    2f8d98a
  4. Upload config.json with huggingface_hub

    e7a86e6
  5. Upload modeling_alinlight.py with huggingface_hub

    19c6c66
  6. Upload configuration_alinlight.py with huggingface_hub

    cc970e7

  1. Step 500

    3d63b81

  1. Finished 2000 Steps

    e0ca692

  1. Step 500

    29760ed

  1. Upload README.md with huggingface_hub

    9ddd802
  2. Upload tokenizer

    9026e3e

  1. initial commit

    ede102e