Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gpugraph v2 #57

Closed
wants to merge 28 commits into from
Closed

Gpugraph v2 #57

wants to merge 28 commits into from

Conversation

qingshui
Copy link
Owner

PR types

PR changes

Describe

xuewujiao and others added 28 commits August 18, 2022 11:43
* change load node and edge from local to cpu (#83)

* change load node and edge

* remove useless code

Co-authored-by: root <[email protected]>

* extract pull sparse as single stage(#85)

Co-authored-by: yangjunchao <[email protected]>

Co-authored-by: miaoli06 <[email protected]>
Co-authored-by: root <[email protected]>
Co-authored-by: chao9527 <[email protected]>
Co-authored-by: yangjunchao <[email protected]>
* change load node and edge from local to cpu (#83)

* change load node and edge

* remove useless code

Co-authored-by: root <[email protected]>

* extract pull sparse as single stage(#85)

Co-authored-by: yangjunchao <[email protected]>

* support ssdsparsetable;test=develop (#81)

* graph sample v2

* remove log

Co-authored-by: miaoli06 <[email protected]>
Co-authored-by: root <[email protected]>
Co-authored-by: chao9527 <[email protected]>
Co-authored-by: yangjunchao <[email protected]>
Co-authored-by: danleifeng <[email protected]>
* compatible whole HBM mode

* unify flag for graph emd storage mode and graph struct storage mode

* format

Co-authored-by: yangjunchao <[email protected]>
* split generate batch into multi stage

* fix conflict

Co-authored-by: root <[email protected]>
* uniq feature

* uniq feature

* uniq feature
* uniq feature

* uniq feature

* uniq feature

* global startid
* load node edge seperately and release graph

* load node edge seperately and release graph

Co-authored-by: root <[email protected]>
* fix ins no

* fix FillOnestep args
* fix ins no

* fix FillOnestep args

* fix infer && add infer table cap

* fix infer
* perform ssd sparsetable;test=develop

Conflicts:
	paddle/fluid/framework/fleet/ps_gpu_wrapper.cc

* perform ssd sparsetable;test=develop

* remove debug code;

* remove debug code;

* add jemalloc cmake;test=develop

* fix wrapper;test=develop
* fix sample core

* optimize shuffle batch
* optimize sample

* optimize sample

Co-authored-by: yangjunchao <[email protected]>
Co-authored-by: yangjunchao <[email protected]>
* add ssd cache;test=develop

* add ssd cache;test=develop

* add ssd cache;test=develop
…ing (#129)

* add multi epoch train & fix train table change ins & save infer embedding

* change epoch finish judge

* change epoch finish change

Co-authored-by: root <[email protected]>
* Add debug log

* Add debug log

Co-authored-by: root <[email protected]>
@qingshui qingshui deleted the branch qingshui:gpugraph_v2 October 14, 2022 08:17
@qingshui qingshui closed this Oct 14, 2022
qingshui pushed a commit that referenced this pull request Oct 14, 2022
* gpu_graph_infer

* simplify infer

* fix

* remove logs

* remove logs

* change logs

* speed up dumpfile

* reduce inference time

* replace to_string

* fix inference

* change log

* fix infer batch_size

* remove log

* check tensor initialization
MaJun-cn pushed a commit to MaJun-cn/Paddle that referenced this pull request Mar 13, 2023
add alias_method_op, add device memory print info, Optimize the parameter storage of GPU No 0 from original replication to sharing, add c_allreduce_xsum
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants