Spaces:
Runtime error
Runtime error
Commit
·
d96cf44
1
Parent(s):
3c81363
remove unfinished sentence
Browse files
app.py
CHANGED
|
@@ -11,8 +11,7 @@ from charts import draw_current_progress
|
|
| 11 |
|
| 12 |
st.set_page_config(page_title="Training Transformers Together", layout="centered")
|
| 13 |
|
| 14 |
-
|
| 15 |
-
st.markdown("## Full demo content will be posted here on December 7th!")
|
| 16 |
|
| 17 |
make_header()
|
| 18 |
|
|
@@ -79,37 +78,33 @@ This may seem daunting at first, but in reality, DL researchers have already mad
|
|
| 79 |
</tbody></table>
|
| 80 |
""")
|
| 81 |
content_text("""
|
| 82 |
-
These techniques are already more than enough to cover 1000x slower communication
|
| 83 |
and choose which techniques to use. In this demo, we use parameter sharing to reduce the number of parameters by
|
| 84 |
roughly 12x. If you don’t want parameter sharing, you can instead use more advanced gradient compression or larger batches.
|
| 85 |
""")
|
| 86 |
|
| 87 |
-
content_title("How do I join?")
|
| 88 |
-
|
| 89 |
-
content_text(f"""
|
| 90 |
-
That's easy. First, make sure you're logged in at Hugging Face. If you don't have an account, create one {cite("here", "https://huggingface.co/join")}.<br>
|
| 91 |
-
|
| 92 |
-
<ul style="text-align: left; list-style-position: inside; margin-top: 12px; margin-left: -24px;">
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
|
| 99 |
-
|
| 100 |
-
|
| 101 |
-
</ul>
|
| 102 |
-
|
| 103 |
-
Please note that we currently limit the number of colab participants to <b>TODO</b> to make sure we do not interfere
|
| 104 |
-
with other users. If there are too many active peers, take a look at alternative starter kits here <b>TODO</b>
|
| 105 |
-
""")
|
| 106 |
-
|
| 107 |
-
content_title("How does
|
| 108 |
-
content_text("
|
| 109 |
-
"consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim"
|
| 110 |
-
" ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. "
|
| 111 |
-
"Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. "
|
| 112 |
-
"Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.")
|
| 113 |
|
| 114 |
make_tabs()
|
| 115 |
|
|
|
|
| 11 |
|
| 12 |
st.set_page_config(page_title="Training Transformers Together", layout="centered")
|
| 13 |
|
| 14 |
+
st.markdown("## Full demo will be posted here on December 7th!")
|
|
|
|
| 15 |
|
| 16 |
make_header()
|
| 17 |
|
|
|
|
| 78 |
</tbody></table>
|
| 79 |
""")
|
| 80 |
content_text("""
|
| 81 |
+
These techniques are already more than enough to cover 1000x slower communication.
|
| 82 |
and choose which techniques to use. In this demo, we use parameter sharing to reduce the number of parameters by
|
| 83 |
roughly 12x. If you don’t want parameter sharing, you can instead use more advanced gradient compression or larger batches.
|
| 84 |
""")
|
| 85 |
|
| 86 |
+
# content_title("How do I join?")
|
| 87 |
+
|
| 88 |
+
# content_text(f"""
|
| 89 |
+
# That's easy. First, make sure you're logged in at Hugging Face. If you don't have an account, create one {cite("here", "https://huggingface.co/join")}.<br>
|
| 90 |
+
#
|
| 91 |
+
# <ul style="text-align: left; list-style-position: inside; margin-top: 12px; margin-left: -24px;">
|
| 92 |
+
# <li style="margin-top: 4px;">
|
| 93 |
+
# Join our organization on Hugging Face here: <b>TODO</b>. </li>
|
| 94 |
+
# <li style="margin-top: 4px;">
|
| 95 |
+
# The simplest way to start is with colab <b>TODO</b>;</li>
|
| 96 |
+
# <li style="margin-top: 4px;">
|
| 97 |
+
# You can find other starter kits, evaluation and inference notebooks <b>TODO IN OUR ORGANIZATION</b>;</li>
|
| 98 |
+
# <li style="margin-top: 4px;">
|
| 99 |
+
# If you have any issues, <b>TODO DISCORD BADGE</b> </li>
|
| 100 |
+
# </ul>
|
| 101 |
+
#
|
| 102 |
+
# Please note that we currently limit the number of colab participants to <b>TODO</b> to make sure we do not interfere
|
| 103 |
+
# with other users. If there are too many active peers, take a look at alternative starter kits here <b>TODO</b>
|
| 104 |
+
# """)
|
| 105 |
+
|
| 106 |
+
content_title("How does collaborative training work?")
|
| 107 |
+
content_text("In order to train a model this way, you need to s")
|
|
|
|
|
|
|
|
|
|
|
|
|
| 108 |
|
| 109 |
make_tabs()
|
| 110 |
|