From 54ef9aa6c133caf0d9c82198d46979cfdbbb12f6 Mon Sep 17 00:00:00 2001 From: Luolc Date: Thu, 21 Feb 2019 14:59:26 +0800 Subject: [PATCH] fix gitignore of CIFAR10 --- demos/cifar10/.gitignore | 3 ++- ...lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 | Bin 0 -> 3792 bytes .../curve/pretrained/densenet-adagrad-lr0.01 | Bin 0 -> 3792 bytes .../densenet-adam-lr0.001-betas0.9-0.999 | Bin 0 -> 3792 bytes ...lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 | Bin 0 -> 3792 bytes .../densenet-amsgrad-lr0.001-betas0.9-0.999 | Bin 0 -> 3792 bytes .../pretrained/densenet-sgd-lr0.1-momentum0.9 | Bin 0 -> 3792 bytes ...lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 | Bin 0 -> 3792 bytes .../curve/pretrained/resnet-adagrad-lr0.01 | Bin 0 -> 3792 bytes .../resnet-adam-lr0.001-betas0.99-0.999 | Bin 0 -> 3792 bytes ...lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 | Bin 0 -> 3792 bytes .../resnet-amsgrad-lr0.001-betas0.99-0.999 | Bin 0 -> 3792 bytes .../pretrained/resnet-sgd-lr0.1-momentum0.9 | Bin 0 -> 3792 bytes 13 files changed, 2 insertions(+), 1 deletion(-) create mode 100644 demos/cifar10/curve/pretrained/densenet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 create mode 100644 demos/cifar10/curve/pretrained/densenet-adagrad-lr0.01 create mode 100644 demos/cifar10/curve/pretrained/densenet-adam-lr0.001-betas0.9-0.999 create mode 100644 demos/cifar10/curve/pretrained/densenet-amsbound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 create mode 100644 demos/cifar10/curve/pretrained/densenet-amsgrad-lr0.001-betas0.9-0.999 create mode 100644 demos/cifar10/curve/pretrained/densenet-sgd-lr0.1-momentum0.9 create mode 100644 demos/cifar10/curve/pretrained/resnet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 create mode 100644 demos/cifar10/curve/pretrained/resnet-adagrad-lr0.01 create mode 100644 demos/cifar10/curve/pretrained/resnet-adam-lr0.001-betas0.99-0.999 create mode 100644 demos/cifar10/curve/pretrained/resnet-amsbound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 create mode 100644 demos/cifar10/curve/pretrained/resnet-amsgrad-lr0.001-betas0.99-0.999 create mode 100644 demos/cifar10/curve/pretrained/resnet-sgd-lr0.1-momentum0.9 diff --git a/demos/cifar10/.gitignore b/demos/cifar10/.gitignore index 1cf13a5..622f2e1 100644 --- a/demos/cifar10/.gitignore +++ b/demos/cifar10/.gitignore @@ -1,5 +1,6 @@ data checkpoint -curve +curve/* +!curve/pretrained main.sh diff --git a/demos/cifar10/curve/pretrained/densenet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 b/demos/cifar10/curve/pretrained/densenet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 new file mode 100644 index 0000000000000000000000000000000000000000..857d4b706a4e58a6e28b42b74d43c98a9dcfef0a GIT binary patch literal 3792 zcmZWsdr;I>6kY+53>$NtQnNBmqjA)68m2MFVa;?k!VuW|`$ZxmY`L`Vvg|H`0fIJ+e0?cI{shme3TApG96vjM>p*vE<}>{GLpYD?QJV>vMYC-ZoG$JK)6S^!r_o zbcZ|3nc?<^%{1FX=r71|r2Cvx96oP&kvAg7Yzv`pq9@nyZ5tnEhT|`%+wYBxk1!*o z4UhXnZ@c)2K!84i3k0=nAkWqD!T}-ewgYAm~yFFgPrF)c$b* z)8(bn0IRAh-n~2+prPi(!Lm*^tMTM9X&Ruj(lPq~{LGBLVUUbG_vp@^5ddBlhEdSi z^Yqp6kj#+bJO!||vy20vZbHJ3x3&NrEscEn;sAi3@T=QufD18qznMQ4ph+5z2Dotw zpYLr}(=v3{>+#1Sx#O?TE`9(>barubV=sWGadK=EK=+#q;UA!H`3w8T+yICf*rzGK z0if64KOk5skse+Jctcj@V}Jpd2WO=|4-hXyeiI;EV()!9RtYw zKz;!9t$<>bS;is+(36;Z&?#7k&vJl#5Hx!#Ko0H9RopOrY-N$`_Dj&o1)(-S1SpkM z^#Byh08J^`{LeMl94V1Z4*>X4i{Wbk0y4mN0H)o7(jc8a0F?j04yOBIPc~ZRL=b= zj%Id5Q*X=bVCdTOQo$Dl#x-D3Gu#nBIlw*+y$znElF?E*7{=bEzPvk~< z8$cIfJ{#AFxecz1JG9fxkqL6GFK#_#gdxCjcr*aXPlk?kUUO0^a}l+uEoz1U=d>kO zG62f0EL{s**+Q)dqF&It(45J_=rUm{Eww@9_D9Z)12G-dCG- z^iZ|i68};UU=mkI@-?~jM%t{&HA=@GrM7s=UUg(2t==p9Hs#jdA-LS|eoi9DSGVlH zVt?H|jMuUYC6`ox#B0G1Zf#QUgBYPUqUf#Go`_ZBXm3*cPgE!u!lS&4617>y`--ii zRK7QOXM~-090aq~VY3naHunsby=pFuV8QSeSX`y$d!)oQ?t}}#_}Oj zgsO6Rh9sdQ`eMHf4c4lP8Jtsti_zG^er-_k7@O6k7~9BRty8B8Wz;g%$CW>4d9^_< zG=n?A&^lVe$u+o7jO>ROShqq$Tv=bAZ>dHH1wZ*acz8^aLwsIb$414qPbnmHva zV@_Ra-kW%dk(wF`S~R!CwdZRB|2kM9my&2i7vN46wDWK;*9rr zoQ_zBYj%8`%WYX>21DpsnB<5}iC^SMaR)4Q2ZoxRAWWH;nCx+P3b&X6_*cBk;|>ZB zGy|oNMAuw*=kUP!^BMC6=_ENW-W3}+YnI!8y4wS8-)4MhSZzaRMwC6+5AZFV`uPDg z=6o`I^isnrhJ1hMotFfFE4Apz`zFAiEkD#pHUpfw4o72)!oPXNa7$Z)P5yI}<+k;;!b zIbW6mNtBE^2_RAR$Bh3Dzs-=$>0dph?+yTGm#~423jr1*)2a6WR@Fx~U9JRJ&YCJ}jsw^<$kKIU4#397wDPvU0X8r(mTYd134MHe9gYq%#4dC>un#1Ane!gi zDD!}#$^21L5eS{EO_E)JY{i$ErPwi#DRRvdtSb*Tz1KrIPtj!Nf&So8kepx|Clx#9 zF(#ku%M3cjj9v&Yo?J-shmT%zKLel$HN?CPP=E>R5(aQ~MG%@NB~mv5;5_?tQBn~E z$vK879506hl5#2+W3rmAKyqPOOI5#8fXl4wk{st~NQ%+su^RzOm~)Amd9$3H>Z3B3 z>=cwWD8+shWONIqbd-y>>(sKw#z~MFQ~w*rCozW$Est2x79Y8H%UsR zT2J!^)^y3Au&QEPZph^hhUDf&{4N31VmnjM1JtQCH>)_$wYnTmRCNZH=S^wFO{w8g z4SBET9M;Imnh)h$>}svLF3dYv+?FaF-61LUpuc~$OoO{qCl@zLnyah8)UmYA^Hto& zUA4~(t9o7qjij=UeASbJx|KaJ0x|^eght6*S4eJ?xZg>W&gULy^&w+5s~gE|R+p98 z!hLU{LyYXRtDu!Dc^ajRDi~z8co?hlk0ZVV&%|H1Wzs z@B*7+ss)YWQRH80`J%?D%OI*ry-rd0RY5kplGr{_^xCqOm5tZ1jX`a6D26H>(Ob=( zcv8)=@v zhcJ_M^+$CYgK#I+R7xhUbD%D;VI**Zhn1Nm7Y_H)>B2nt!L zuHp>SSWiEDnW1h%E^FuKq$uWSr7@PCpC=6Qh@N>LiU%?;e9?=?>}oU3y`)ldB0tha zI~U|Blh@!M4#4xu9aij^*3nii9Eny{g8t7P7;qOi<^4%ykHzPe-L} zX1nA`t}uhzgH-G6{;E;-&b)|pe>BjZHDEs4paz?T@;{K%-F}1r E1>a$AMF0Q* literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/densenet-adam-lr0.001-betas0.9-0.999 b/demos/cifar10/curve/pretrained/densenet-adam-lr0.001-betas0.9-0.999 new file mode 100644 index 0000000000000000000000000000000000000000..0a6183dd0af5fc7cba5d7bcd2695608e8a20824e GIT binary patch literal 3792 zcmYjUYgAQ56h=TomKnJ$-=>yInkXyZ&#Q=61yqDHGnq&VSAj(rE?g8*3Dd$ynx-a- z?2LRo@)<9=bocAN$Pg+56ky-g9og@7$oY$14Xv zXqj3(vTZ*;XE{!aJ!gs5O2AD@iObZ>fMdRoFHS7ug9y4zC=3)HiCl9uB2rnwSa z?xd7)ZjbM56$GPqN`@;TD<#*J_xOf59Yd`nAC3w6%jt*-3?3hS_Kwpr>gW3~ zz3Ozt-nh9aIkU{^h|51(w5ci%;9gG^Jbt*-Vf8tQ&nbXe6`h)_IS8=f@9!_ZSO9Q7 zV%>>DGo23M=RJ^`_YmN@F(GgX&{z9w1rT{XZC?1t04nB>_gd@)m^O6(*slEnX7a8L zuj>yitMmzz0ZMrLzMP+)+}#b!K^)n^7vS`@w+77V4seklRR+9L(WxmczfaH~fIGLh zKDz!kz=KCPevs24eUbY8uK;Sd*o!~_0x5S{Z`u42S9-(pJd&xO4$%DW?ud2Y0W{Ou zi~;C)R(k{p<;87g=u=?{!-KSW09{5m+a4GO&p88fGQfV?4?sX-U-jDbF+c^gPae63IpuXdQLHuF25I(is2+ zw^r@wSWkn}2Dz0(0G5yrCCg8KWGeuV=H@*pZ+!+}5ope>1enb=U7-Ijg#|P{EmI-0 zv6KTV;@}r>V4JF9A#Lnh&azqCQnLWdIzFP1*;vR#ZR7~ovSl5#-|}nhTF;?w)@2XY zen_h|N0>0Smbb=otXXpfnrIFHDxM0!1h$I$LUIqv?a*A?YAm)X&?#^0o3Y_S5WsrW zzi2Z+iS0-~V#cPdYEmM?H-qs0K*sZV8z_SYAdGX3oV*u|`tP{Ya{ z++X`3zUUvZrc}Gh){9wMWz@OUQVp_S6$<+MfWsIKtzk zOcg;QQ8V;B8|8GU#WcRumLN?%EOvWg?5I*|PqiQ2pgV$<=cT=(Y< z06ktcnd%pkjj}_o3(Ey!OqElos7o}plr7bPSaT^Al6o27Ds_swOcPRF(!!jg*XZUB z0JscNZ!Q9;Wa`TG@C$^+zFRQ))m74%s-PjPE|J336(+$PQH42u;xKlZz^d$q*AA&u z)UQnMZ}u536{s&qSC-el8~x&Ozv6DJAdSa(sL^9SqpHRh(ol&Fq460PL86GePqW0b zuRUB8aeT|g)u)EA^7I^h3Ad#WWoE5r%QU)Ptd$Jfu*1h}IYaSSdnpX-E}Af7BOG$Y zL_^Y)^^j_4rSbNE?Z|KwcB8w|dP13sTI~5GEf#f_-IquZquCNhl@}>|R%fQ=A9gs3sk_752hc9-CI|l-$IMv>-X)^V8hUdP zqlp&b<|D?l=Ml_LlD;q+AomRFCu=(&v4kJZCIN_EoQ@%CGL=9Kr<+Hlv*&(nX-~VX zYs8qasN5o-4i%jl7{;9JIgQiF;V|ZNre2QFL1cqUv&ow}g0R1W?T2O@6 zNnkAO0U=dk_iFq!UAe(a^K=KpDvx%@3Kg!~mb-C>K zN`8eA@tnIUN>e`6L|9BMBTRKZ;WdfuxeF6zlZtU(Q#eDfi(}r#byw`UkZZAm9~nsu zWratvkg}+A#RqKRDIu6ck;f7>xfjzBmVL$Jok&dN667+g3%E=chicm4eQJDBK)qbk zjM*%J0(Mx+r!QczkOgVF+jQ;_Cc!S3ep%~8Ws<##XW5mGkXk8UVEK=KIi%` z3UW5B9`ztJxjgd8esldJ>I3j^j@vKH?CR&|mztL1O_`G7jLUGOd6H6G?sjl6J7dL} znWIqtwPvptNS#FR9zyM4I78Gyf%TwZsF z@IW(Ao{{33=6)fq7gMY}C#>gGSzeEAAM&C%V1&8~Kv2>x`_^>P0I zjQnoNgs}SnxhqQExjF=34}I!tg(U>Er22!vkO33#JM|LngF&X$P@wg1`SQ!cmd#8C9=-}s6)n4w*hWU8n$rI z+W@y2>%L0fXbG0V>^8I07`aV?uzN@!AcU6QQ{@kqei^b1fY+;%b05?Jgjz=f47h;s zp8+6JcuhILaO*?>n=~B(7`qQ7J}WJgk^NSH*t%Y4ZcG9g-4&+403r{8#AtwsE+Vi; zDS)V-b-wv;fcL;|!)bun?vf6G#PiK}_lyEaxZJC>asTa^qjUA4eWU=?oW94FZo@Nsu|;d1|{0A|VFP6lv72fgb7T#&|ZO97IlG+qLj z!BoA{cPuQ^nJRLy1Yo8hzl>v8a;RRIlkcFrGhoS5Z8F`p`wP0Iz~Xu!c>$P-I>%H3 zAR_bvFh?Q}fLm$9oEeUK*1}?`CJSKpC-|)b$b*bvZDa9*u#si3WGf~33e1AkMtqE= zOfps|3r&>U*(P1!Y!n*tJ(et*BLU`I9g;Bq>9*UoPo@-R5SH>SI@<2?pe4Bv<&x5~ zIUmILTrbbzt~nE=B4H_J3$m%qT=pVUU05?m3SlOkv)JW45;dPP&L{KpC>yCKi)UR< zA={J>feu@U1Lv{1iy-}8XJJ`L5{lH^Fqe>o65P(loAA+9EM`8%^6ET~r3GrFn59yx zlEdOhx?I|D>SFgIEag#un5}i1*cQ8=EL!g_rR*mMhstU6Va<G^Ns3xyK~*5t>- zF3!+$R5eblr=@}+wz77Y`Wz6)$yfoKqN)3Wu{5iC`xRz*j4jwpe!gPP)%20{$PXW} zL4I1j3m`YihfB!dQc+^B`lu1L%y0{Rc5>Hg=2J=LE9tCHzQ|plE3t`cR(g$W=;VLm zIUg`po%|Uxwo$29tR$^<>ar0?4s{Fe(nojaiV}cPpi(tfaC@0z%wU&|ttysLq4@EE-71!`ONB7L zQ5hOlsz9Sk)n$CGI%x1-7}cs$pXD(6CNG+CkO%7R+VZWsUxsdzK2R_5HW~Yw^8s}| zeHI;EpL2vH=rnvl3Bb@kde>>@b3|PSgVV;~l<=jhcd>(pPE3PCWL5jpF literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/densenet-amsgrad-lr0.001-betas0.9-0.999 b/demos/cifar10/curve/pretrained/densenet-amsgrad-lr0.001-betas0.9-0.999 new file mode 100644 index 0000000000000000000000000000000000000000..32d60ff3fe7eb5760c701d0b2605356c5ed7d31b GIT binary patch literal 3792 zcmZWsdyvg#7+$-ZWK>3%QRybJCEKVZHR`BzurAB)`MxifwRTT?nQhnEJy^0X2_*)z zYTYkIC>gpMZOWyzUEHOTHf>_Vx>ZKe^t`{`=XcCFfADy}+w(r}^M2pYxcDiJ3(wDg z>fCJwD^hPr9v9!ME&+d*N8*xP)3~^}p(Vx9;_TwW%;DjZ(){A0NCQl8S7M|vKN>9z zXNHS%^0SH}@h`f@2u4Q^4QH0-j|!JY63QcqN$xTPOY@3LqLIr|;#~s%m0uK%G)zf! ziLys=QEue&l*D1fc;*$dNl8|IQD# zHEQ3wE*MCwdijZ0#y1QG(sNf|JL+IJfUVoUzkYJtU?6n&pbn3Xt_K+ZQpc3fR{$*S zZco5r`z8lQDp_W<{0LQUNlK&&(@X1Muw7*Y`E< z3^3!iE%TPu0xalL^GHsAfOk2$N{N|0qYegFUyGq1l!n>)<);&x6(e%6VXFi8-URSF z0!6a{&Xw)CaOQ(xz&2=ISGMQhi^0_!hJW#1Cq$Yx>ArqY2Y_3Yp}h-fEkB7!D=hB% z8UVAf$tJOR#V|x3=-&d20Pf@R)Gm-?DYYRnR zMDiea*AYm2AJGfwg#9Y+}i+5I4ea3cz$|D(x00FCPAkQe*nzxdvxM0>j27kom%?3NdgbjP`mdWA~$$i5*q;V_2hiYTH5y=$3 zED@IABkcnFL06%Op^uPx-(wep)s@p=NklfW+@HYL!>eTU=Pc*k8`$5aST>L!T-In1I0P@CL*;+X3XCJ-@@|IDgdF}Vimv-touG{c#uUo zG+vqzbAFVrdJNzvj~T$v(%k6)zj4E#*(o&?({s(^m{T_gzqtTE(sea(=%(q2)JmN; z0vw@{egWl`=Vg_gSq>mFdsY6GEqquCn1i9C)bM)>euPcrui8&b9HvmUdJ)+(Xv$Ux zu+Le|-Q_~}?(2gAH&Lb*?ry!%4i%5Brz#_hso(WeHJcS{YH0(`4J zbl-`g#v-y`uL5^KuFTsJsZsy9U(}F}^>R$v9a3+&TIKAhm^-ZP;Of*i?g-C1LWajw zc_$Zvw1YdLK6J;$HHjBTj>%Pb2O{;%>r&v|_d>p2??ZPI&r)2RMAWOUUi;mhp&F;x z;A(qA=4dawQ+m%k*2|p|iv2JrHpCLdR;fkZX}#;*NzagB*GL}6aB0+g8xscNeGLXu zrhbjzH^D%kH}tma*HK#}U3@5)ZhER-JZbIq{PcRM`)Ul)0_n%R*?1efVo}mx04*4) z)FOnIDA~|1rIt>~{YdCt)x%t_G(zjuZlTQ_YM?Ysdu}L_$t`X?p`o;CuH-}KH9>Qo z5;Msvu<6ECZIq$8n`doTBbx_Rme}$R+^44|Xh!phFo$l?wl=+a);NzDWMRQg9#0>j zzKeYzlyRts@-c(81coo6@!k@A%Y@iZ<{r{0B)AiXJ~|Ob1zV~CVl{n^A`B+O5XH=5xrLXw zE>=Nb`MDJ8Q40PrBmO=<=UlaxnZN||$$1S=pFpam1S4pYF{Dw!pF$<{1Th!-c?#$=K z$TptGvS_UyTvf__d}n&)l27R>R_A^4S-_pAP)vWwSJn4eglBajn5E=xC*@;37Wl@u zPbdw`Mzg7^s!dY^*gjeU+fOSP8}cJoy&4E` zr%9d{ku}=X)@qflPooz%^jG=mIPLe?Su}vnQ2$tVK`fn1mtT6QuZDL59zfe)>t#I& dGZ67P^U95>>QAOyEW1)yh2=kx10!+C{{it>NE847 literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/densenet-sgd-lr0.1-momentum0.9 b/demos/cifar10/curve/pretrained/densenet-sgd-lr0.1-momentum0.9 new file mode 100644 index 0000000000000000000000000000000000000000..703a5fa1d5150438cec1216d76662bd14951b162 GIT binary patch literal 3792 zcmYjUYj9Q76^=DsZthLO zBTrH_O0C0Cz()WzM9>KiV#J6TY2~F-CQ>_AJC5yS7>7X=CRJ+-jNd-9z7y^b_*i@G zz1RBIx7OLTr9U~Q=0aEgkJ;6`7T$1MTYBN?4E))gNXs$f)6&vv>*A?+MZBiGAySu& z#$$;q;9#!CN=-DCs)>|GVwKUQu|#^O83SW#b#0_P8C?@eCNi26nK@<@jLE8aT`DoE zAl+o(U(r}9kyVgsGVK}h*owr@3Nq{KdFPe(kh-POSozY5io_MAiS(RsD1Sj-!I7Qk z!l8v~$=oOM9t?+y=bm|Va({6+`WLs~_yWMt4<|mm z?(uL){e0%>Ri9h}m{qxGQtxPh{P{0_c(4OtQOl42{N=|0k8r8Q%bd8e9+u6I&q^Qr z06@>={-QIF0=!;Twm6n4>I9HS2 z#4G>*s%AYbtrS2^l~39X@NM zQ@pjTX|TP?s(223eBUg9<_+LwDnPw7nwLx+sBZb6JqNB$-vF$pS~~mgL1wT7DJLk} zR#akAuXVQNS_06D#vA7Ww6Ws?k+j%kUc*ulYTF^G#D!(u(?&AR3S<^;#+!HqSW-P76JS+Mdpc6CZP!~Y3y@T@mJ-fR; zkSJ*h1o@auHm{ZSvg5;y4~O)CBxr6B>P$!yG>dJK%fcZ;jhPOSx>+aEGFzmSrb|Yy z**%N~`v|-2Z0H#RcuVpc0SD;(mJnqQ$UHQMY~3Eht^w&Lb3}qS$2KCdRxBNsUN&!I zj1BL*+|nm4Z2bN(SlTZdGl$V1Ip4z)#IsK(fO${4$@EL(o82dEhH&03sxxme_gzwp zk)@X~Y+ktl=N@S*vqQ$0dBM)SJS@E|gqv+X^|0)emNDH@O4B8pA0abveulaCF!wIM z86##i8aEY5ru=VXMk&6p;ZWgcQp}=kY3rh-jK<>6tu)8rBbg`M7oC-vw7fMX0&Ls(XuARFxG6zD3R?62&UJO;kb)gAXEnL-=vtXFQe+|B=PJ6!oJr z=u^Ua4U?!TCH4*kwpl_|9CB*Dkf2J1Lsc#9;D$x~>J)v(QDZl8iTZIhiBgPk8sjOW z>W=v(Lp7^NkEXu1C$-5-M zrx_1SH9@*S*}rWConR0Rk=~#|1|`$tE;4qMcaatq2$FADbu};jE#=4dbQSCVxkRWJ zO9^zNoUB_VFx?{CbxO$8d_d_Ak+G&|^%~Kb<|NU7;;v4qpze?ab*J=>uAn8jlutZe z$?bfeXv$beBn!<_>LlaIJ%fCppONhgrOGdWLPzcxLSwATC(wuC1uJnbT&ES7cTBebNiL|hV^$bzCzLvZ4q)+u6Kb?sE4`gW~ H?Y5r)#}5j2 literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/resnet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 b/demos/cifar10/curve/pretrained/resnet-adabound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 new file mode 100644 index 0000000000000000000000000000000000000000..a25caf2be2a8d2f7f93712058ed19c6d903d790b GIT binary patch literal 3792 zcmZWsX;77A6h=fd#vC$-)J)B>qzoOWtQ=FXxm=A<5%2eXI^pgC{0b4o|n$^e$9A)z{7dZd$#AC^Io!i3;Yx6 zKO6bD`}D8Ib?TGl8+yAXer9-lf~)`^AD`ruByUnoQbJU^J0&$fDbdpc3f6NtNr?A) z6Wmem#Mt;Li5}lYmOq5v*~#vx)c85>R8Pwck6)103c}R5q!h2GRfwvV+2t}m$xf8=yb=+N-j-Vt8_6d8UUSET_orXSlqz;ZfV z1Bb27Zv862%AMU0um2L@L|)g5us@s*!>_t;=S>Fz-kGL801@rfeSig((=#7m0odHS zXLa9~0FL#0?e?tm0M~~uemCSOz=LR@kDLy(y$Wy!K;VeYKOM>icw6EzM+Hm`J@Y3d z69X6a_H7H0j3`QK0CL)n-XGZ?AX8#CHzaSl;6DhGP4n)oh)V_7ekiwn;#zl%|V&~j&?&tt8jRw;gVI;!p?W>f90xNW@1!nh6Da5KdS>(JLZZ{j zVy3e}VCY#KWv~c3p3I7{+PrQ!S|p8aXa5w_vM$t0j+NHQ#W3`&hQTFjZ46PqWZo@pc_{}?M|g?dt5%d+ zo)%Yu^$24>eLf@_)YEc32ftn|iOJA;!UVOXL9ORWIBFo3`c?yb-Uj5Nfe|*!(z6

b}?euBTtn9YhsK?Qr>TP}-TSnl0bvj0QWdn^ZRWm%w=@{Ej z7V7wHf@bD0@!=oHG>5ZICQMTMYc3wi>uR}RyM*7Ch2a_~)8mR1He8D^7hNmxZ2HSB z*ULh$tD7X`3Z-P8EIHS7*-}PFSv;=a#g5Sn57?Fqct3kd@J3(Sxh%I_D zW4RR5I7E;ml{ehf(Gd<|sK=%9#uzEMQ6@Ds*3pGFxK!$FQV#kQ4)6)!f z4ZqaPWSz;o!PmezDf4Z7%kqw3f?2F;C3Vg-i}Tc}cmRYRGgh&N+HyX}AS>DY-_LHBDEU-~z^6CEktSc)gf>eaGIoETd-}=B+#if0w=r zsAGpJJJN1Q?Oofs#X|9Gh4}*GSNo1(auO(BHe3>k!xsP`CQ&~$iV6&NI$JCN?Cb&zeG)aNU zJ~UZy+n3g%4T#`=m4NymW;B O9l6y%kP#lAKK}w?U|#tE literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/resnet-adagrad-lr0.01 b/demos/cifar10/curve/pretrained/resnet-adagrad-lr0.01 new file mode 100644 index 0000000000000000000000000000000000000000..9f5a3560dfcd7574f7584e8311a591adc9ec72ed GIT binary patch literal 3792 zcmZu!YfzMB6kY+97&J96h^UB{Fhj>FrzuC>)L4}q71;0lh7s|?COEXPu#gfO4&zud zj+x`#G*c7QVZ4x|rlg6A7f4W0T<{tZV@{Ih2(s8Y+j(A`q5T05=RNPaJm>N**+!<+s}v^yQ0 zB76)VwvlXK=;$2blb#Nrud$KTd5QM8c?%XeI>b7>LM>+V#OW1{`7IXn)WjF{Nx73P z<{5!O2Yg4rX)({55xAo$?NHME|K|i9qz$JrAOu6IdB>e(zt~ z3GAoe-ySCL>z%RjG5rZVjo~;fX1#l-A+@9W5g0B8_3%&lLy|eiW<6XnkU-|?oF4W~ z1hN(_YjO=HusdL#^W-7|`zftS8wgw>bHf@4T#jec1nyZ1dS>1u(3p^VF!-FsY?vf? z!xQNQlK9Ilqd(;ru#O~eL-MY;Fv2B4BSL%`Qz)(h$4HroBhCoK6=jeXfrXT3SXTlG z-R4iP_?tk+$`M}v(+D_W5LpLzi{Ll+W<#uVFt~W@ z4+M5d1&!?+SI@XJmLz#xiuruRQD_AA!SW$t!`M%u&-#;(q!WxI@9>8tha2->)PG8# zuyz#LW$$wi$q)?@bm1@e|}lR66#Kq ziNG0zaRzyvZ&-ZY{gjT*vArGyO1QRPFhDvbRNBRrB)RAcxmq`uKpB^|fIu-=E#nFp zBq>EHOQ`I{+eo4emU3F3v5qvhp>9V3Y~DnbDtzNXtqkK$-@;SDJOGDxdbZE3AfQ>>gXoguUbaN zsN(SoV;3N^hG&sG{N{D{lcV7TYPb}$SprsFGL=TjAqc%0><1t_v2nwcB6aUJo$s@$PG5!JkvfbQ9A7F}j3`HK;a&MTy^a1dYF4`x!5S-;t&!r(dQ7}qG0oOWYN^m?bp4Vz)kcU5 z>sA0f6xPSGP?e6>UAB}qSk}1~bcH^p^w@UxV~YgBBn)l5Fs;pnoe$tN3&Dd$jYH-w zuIc=sP9cDJv^X4bfV{x8z0lbUr(eUxcK~Y<>U!K7FGOi8aceVwwva)Gycim&Yjbf} z$kdeO9Ga$--E>Pi<*@jz*3#i?Ck$qRp8~Lv2jxSEFdt!D0zZn4Jur9`c^!bkvnauj zQd14@o`xq;+aQgkT>xVn0g4dMF4)-vJK6BH5Ahs9%H_x_n|F$XQdSWb$}_HQLV^py z^EJ3oL_L7Pb8w2z)J~y)R0G_FuUZ^^kD^qAIu%$2j+CSvJSz@&LV^L&l=3#vt0XM& zbhxTcjdZV84>CClPa`SjOF+VJphbZ?)KnGaCbd3qdQBbil+#7Crf!`?7*(ig9&R0n zchvwnAp8%6p^D1 zYXz}D-w?IOXtqYAd>#htrGIpf3VpNFu{`y@61?79l=U|xW&L$o7kYQ8vff9^qz6ho z`XKS8_koK5AxiHh4XO8&2-|L{>%F9cdVrKb?=QLQ!IF+1IF3aWv$~~R1WEt2>3Hl7 zBxQAdK+jAHmLv+OP*tYt7M8FcEEUv;ftI02N9m|gm5vHk1*QP@ygn2u58=4z+qym+ ZB?ys;(+7cYW%(@+2{!%*GS*=l`7dzELM8wJ literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/resnet-adam-lr0.001-betas0.99-0.999 b/demos/cifar10/curve/pretrained/resnet-adam-lr0.001-betas0.99-0.999 new file mode 100644 index 0000000000000000000000000000000000000000..29a0e44a3752b5f87e098151b0bac877631a007d GIT binary patch literal 3792 zcmZu!X>62L6fJGp$`S;`TJ}Xcpez-!vJaHuG0Mi2C&|XU!z$pd~Pe)Hb0?SW0boE03oBF(S z0Jq|XAbWsot0x9-d=2nRs`UYI!8$JnxZV=^WC7gia_oG;2q&l;9zEUW`Nv_od2!B( zyMF@Q1F4tS0NfQab<I(H#ya&(&X zpJ9S&wn`(hl!8*Uc^)8<$A^LVJ*#0!7bR#18d#87|7yu2**{Lew}Z1-5#60+9m>^sXVRfJkh+)v#s12ONAmxJx!#ppYyYz z_mVSKk=U%sSQ%BPq#bmaF;C=DL8n?29H)GzxfF?iPq7tdrrpEhPM6Nr6X>)U5=ngr zdnQqkQz-R<^993KB-`WEa}n!4olV5ypndP08+yiZD_mZ1PJ%cmXjVxH%&WEqQ6}?>{k#hBnv}qJ zaSedw9TZ^r3V;uUaI;B9rP)dso29ts)9#oT_po^zy8Pf*76>h7C%xB9u^%kinyg<1 z@VQJ;vq$>fa8R4ir6{J>3bQpfe<_5UebQg%8@vFQmSbtJ3=nfb^ka65dd+?r4(1Sj z)uQ2UpTVhpG9}D0ZazX62T03)%!WBXV6#^@j2&~>8|xOxi)IeX+%QL^g60?=#i*!| zX=ESAP*t_}Hpb-PeRYDVF5bbwO(!^p;b(fgqwqHFla?K~PBI&xESBsnZxh}|J0|R0 z&q)woa|RL^nG-o*inRULGUuWsN{|RubH;pEa#sQ2P{q?%x(G)-CXA`ZyfBej*!gU~ zjHp%&W8z_aj@%zlE;B6?;V2eP4W{L3X%Ro=x=^3xg(PlZ88K{@aVuC#w;Xr0u zO2Fc(zM?3VDML=hGxuC>9xD}8{pi#`&c{trnJSG==P^?%O8I#O>D0fOWm08K@Ntsq zGe43_2(bj?S><9bO{Eh23zKQ_oi61mpQwjKNOj()ibPeCE$Vo%>Iare?>=KsuyDS# z{7k({V%n)?q%M;R*9@$j^!jZ0Wh!K-eEiik3Np-k6|mgC*nDkF;vQemOPEgNfs`xh zi%nhUtAsW6OW&$flqb_^DJAhNtL!^nL|VpBbrlpz6&0Sr_VmTZhSls- zogl|`ThWhZ7wAqxl=jMn0irt#3IAj9#)kb8$_BY_kEEkHWa?b>rHgiwpyqJUy(K~2 zN6M|)xw@U`N3%?IOAn^gncn@p8j6rK=a_CK%xizMM?8Kx=>bwo-IGLhlisPzltWmz p7s7Qj0!}~O@qsM-%`HVp+RGS^c3l`<8Q6av7qUMf^CD5b{{{0p2-^Sv literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/resnet-amsbound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 b/demos/cifar10/curve/pretrained/resnet-amsbound-lr0.001-betas0.9-0.999-final_lr0.1-gamma0.001 new file mode 100644 index 0000000000000000000000000000000000000000..f1ab253a80261b48c31088a82ab5ddcee839e96d GIT binary patch literal 3792 zcmZu!c~I3=6lT+iF*9`>Ej6-oXw%HfAtRr;yp&uJ-tTvHL_{IM;5{BZ1W^Pe6hv7> z!rUztBx6X)(wt({%q5pW%xyFsQ)4uj97tVFA4E3 zS3+!5tUV?^+V1qp7XdK3W+%l)rNn2%rZ{~woqj>09gHb)j%1g!U8s-n#lPb1E@%5t zKj9~1IP5c=kA(WArt;25Wsv0Pczaaz^yyCTNT*Mb)iV6L|A4+tv#pk~jwjcCH|v1a z5|$PalJwb0t7XEWm`Odi_**UE8;8vOy)@2hi5S&w;Y&Up02)_rycB-dYO%ecKH28Z zoOkc+v#{*=1V1aR7Q@?G(>3EFz>5gHzYZW2PJbN*nA7Lj<*DxiRD|xUytxKoM|xw+ zo$UaPaH;7Ea5bTDSb2`sV*1wwi%!!3x|HX%f9@Q>tGS)+6-xldPaD&4yBfeIzw`%4 zq9uE1!JyC|VOikUz09=>pyJ4Bqz_OPb}g^>HvqL@#LEldz*(6Pz?@LnK1B4+=;12-q`Z@zll(`QF z7)P&(s+Gc!Z67VqFpbFmxGW8psft4}#VrL`>|`TG5on8P|dQ)S3@M`Q)8KKiQ`PZ(!3~Ob92bgGBxHx&VO<(4i{o_!mb18+m~W; zh89Q*zFf-#C}x`$$wd+XOBSafM^4@ZSPIn!5XBT*e)I0)$uB${r-*8)pa3|+!Yz$S zIQ+4iZc#4BRLZ!hLVg5rxBV%A#cIWgQjUyHbtTIw;VdsDKjmz9iP|KhNUpOQ1YEXD zE<1oi3i}M@cbf$^GoQPdv%RZu_$~|ln`&v{5Z%WXT)h=%9;huUTG*WyIl+GTqz}t( zyM^6KN$A55e!|aTd6-+Gl{xD(t+Go`<4mg@!Bh!oX`?d#$8t}u$cGQNa>Z%jap&PS zHn$BMZg(-<^_ezGLR(t3m;R*PwT0uLz1pNSQ)Fa)g|=v*-L>W4AXfNejk#h|T<*8g zHxlow)iU~&8nvvoV;iXk z)b^$V5$9DLoBUh8PPRKT9s=4fV2DDT0KchEMu1x9wp%Ko(XO}j!?QU_&76&!%tlcd zuk&dgrnZaGQ+8!Cycp2vB_}onmNhCL<87WllV3_kuwI7!f!@g%cK zO{%d#b;lUSD%cAnmzK@y1v9Sj@Yl>Rn^g?tU0;Fjpg&RRQuWRlE12pOB^#rJY3w55 zTUbRRyQAG@Ss>kFoMO(J!wqbA9YHloIKec^3AQmq&7p473VLZtOk?ujDq$NZ*`3Sm z@+AiRo;|H+U7yoy56@^}SCb7*?>Uxym8@nl;IFLfID2uHk*|}wZT!^C#0uE2^Hlf^ zGJk;?o?#k$=>9XC8%@I36KF3@rY>0%en4N!yCkW|-(nnQfx6_QEU<}Qb18r_GN!51 z?m9!g6B^hionZ^_I>k*=$;R=aFltGH=4T&k7u47>p3!k`kj#2&o-=6Xs+`R{B{p-p zieu)hG|V!^v&jNY&V>i8QPi151nX29ro2=B=h5WeFjuQeJr*61jWa8iqD)D%{FTKM zM}OifFgb%J*Um$~MyQfal4-hIi~lK@8(Fdj+P#)u`U>r}NfGY3f;-BS^ENW36Vn#X im-z)rpbkBWX)mrXvs!81)QQ!(=POqJ0vYM_>h}*MB0K>A literal 0 HcmV?d00001 diff --git a/demos/cifar10/curve/pretrained/resnet-amsgrad-lr0.001-betas0.99-0.999 b/demos/cifar10/curve/pretrained/resnet-amsgrad-lr0.001-betas0.99-0.999 new file mode 100644 index 0000000000000000000000000000000000000000..53f1788a7a8837481445f921bde51c5050e3d6fe GIT binary patch literal 3792 zcmYjUdr;Ly6h=V8M-JnZZxhpqG&FL^7wR>Y9|@uecX!7G1i1-_7cN{R6%kZYz{fCZ znSrMHOmY}2$JaRd%rwohtT98y=a`zBm0{NO?XPq8cK^`Nv%6=%bIy0p{w(vaYMuL} zHl{f=XX}K{{mT5u-3q{;b3K0HD#XvvFTWtqn>RHtH*Kb?pfEen?P-Ax>S?UxW_!K4 zt~8fBGdtbw@n5W3!|0ur?@BAop6x311kCjWhO3q^7G~uYcs(uS{8a${mF@O=g5m;I zp!SjHp5}QfF0iPG?`)-=6r^Xn)6%C-^|VOw_=j7L5zm$f^=|BMIbya~JhwaXj^&8& z{lTWINq<_7@s0T({m^=t#e_ z`*&G)0N`uh|$BiZWt|pD8Aryri zM2V8IsAxzAmb5f%&Iu69-5OY;zsBzrz-T0O%m#qu*}6R1!XS?0is4Jg*X@M3uqWdI zBAfw$BeR=g^>NaMOohSP0m}r+m~^c_@x_Anuq5ig^8ltXpEOi`Qg>L=Kr5>dU@}q= zH3A@mq$T5nBg1aZf+e%l3e*rlae!r^N6-+k%p=uFyDdDh6ml)nZHlmD=yLrwg z;V$4yRY$w8EQflNilS!F@Km-!F$z=_m0M|r>0za6DG6#bNa%)DTS)4vfrPELv%^m* z3bmhTsDo5Wb(kFE_Id>ALr*_8vX}1ucpp$9%Tz_%6XBGAE&sS8>xw%x2Ow!;0B4pd57k@c$ESa z!E}WPp{j~D#90jDrNQJ-45zG$vCR2CaTYJLXFEN}v*5Id1U@x_o+%N|p81^-F~m^x z=RL*}$9y{Q9>vFPiK8f@rHueGDG9=&gbRBF#A0a*Q+4oC9RG(KL$G?LIE`5Uo^>n_T9a~9Rh=h==1-(SMbiJHzKvoZzC#`l$E?sAh7 z#3E)mk8@}^$8yHfIj$0}S1BK#&ypx(C73Jhq+(786REjtF^98~GjCt6Ki>>7FE5$R zX30sy7Ae#_La{@h&|(wssbn4Ia0v|OVlKfFTYtFSFsx(GllYV=frpFIi|b`dV5nB{ zDP0piP<^GW=NxjIiyC%l{FuU-yG-VdR!f*Ozr&)IJy&q-#?N-v27gHj{;UvNOcMCG z$@78%`UmocA&(2OjkCIp<;SU$9m%1Lpd89R)cBH{NDg7k5K5Hq}FtqFTr(ie1`{F-~PPB}xt_(aJ%j7T;zbO)`q=CF3Y#aug*&@@$a&J`>I5-TV992t>h`z|eySPY?|S%@9$M zF>@_bb1QQ}Gc__bbI&%X#@1<^7E3eRjI^fjKF{~#{Q)26o_p^(-}%nDkBZni3Heu6 z3~B6=w_#ML-W9PU&Nj!-@^DO&NsNh!DJ&|86l53VXO;wuigOD>;bw3!*I^|;HxkJY zW(GqOa>s|lv9nDAjFGa!U}kadlwfhVd3iW4$+Up6IH#Z}5^j+iYntP)+)yOkGBwV` z*)s}46T_`i<0ehwovrO5MdNcrnd7sw!_6|nu}Oa4z}9=l_8U;{_YGUJFw&4W-R~Rq z;Gy*wUaa@~#w30>ZeaC&eqW$_!o!7YJ_GpFuJrQzRL@zr?izg#Abf1!%ytC;JJLFD zicbb;yf5|8`d|G%eY2dS2VhSd2bQ6UStCCF4Pe6ZwPyl<1JuM```Dhb088y>8Nh05 z=m)TE|vGrz!c_eDhZG(dkF;2;ZlU`pW9$iNk^yj-+dJ5V6`v<_-(;cdM#sXLd9}e3ksi`xmvSrt=`oNO4wadZf>i`P&+E@W1 z;A`+|yY!*e1OV&a1PVnhO}jwl)pNpR^*M&|EDxM|2Tpv{9>`jhiGG|?tF<;*Do1`D z7XnQF^FVES4}cjXKEAl|3P7%?*C|JUtB%7mn?B`mx%>kxl|MtQV*sXuj03e6Ku;w{ z0V)vS+A{z%M0L(HwiGR4nJrp%N*MEe7H$Sfm=3LV-UR1rOX{@%wk@n6ooTFK4U~TA z16Y>Qrxg8h;U!pROUF4gp_&d=u*|bcF9nznt(~s}Sb&bX_$t86d+Z0Gj498x*`&i# zWmP;BU@G*O@&Z6LmFX?9(VRKx*U%F9)JO|EH7r3D34e}~02Nmy;f1ul;bIov+=o>x9(Z z9D&qs-DNG3yE!ZsG*(Zx&CLmH>UI{ub3QDS#CYHX8H{GX%sTVFbdxzWcol5eepE)B zIbyqd1uXldI!)*7m*Se;q6Bk5s%+jCVVeeqx>Gb}>gj_9zIxYoGPXf_*}QItUm7mm zE_2oFwq+j&%cc|fybn+>Eo@#RhcC;BYqIchFgo6mKxPM3O;I^q&WHwv|iF*cqD_;@d1`M&{aAkuw7bKMPHfCcpLAeC0Wi1ESBC? z1I42H$;s*+8CL=Fs-pGABvXG2G3v53vDzs@R_h41$adXUPSzc{>zr_=*u-k0w6)@l z4D=F_s)xi`^Tkk~FpH#UKp^1?ea6UxqswLc80Mv)5Hj@=*`)$)k{n;h0J%5m^Fjf6r{eNDaQzPx|9e0%9Q&s!Fw4Y z-v@mSOE8?;DCDjy60?pMK?b%9;kp&CSVuB{Bz0b34+uZ%yp&RVDYI~Tki?_sQUGsK z;lGjj0Sun$=%|kHkm_YD!A6R97%ej;ROPA8(`p;i8@(LkLfycx11;FpT}b9&vFPO_ z%BF4wsm9T#uP~;MF=eYqJMwj3@o~JqsALz^iELCpdH#ig4I!&XB`?*Tgxm9?nkO4h zD{9P+8xbHqrV|hH;tEiVT@#`QC9FwxQ6_Afl+m?2ZAht T=i{*vl~0eL{Rc859Mk)MF?lMI literal 0 HcmV?d00001