You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think this boils down to merge, but mv makes for a simpler MWE. Glancing at the code it looks like it should parallelize, but maybe there is a good reason why it doesn't.
julia>using Distributed, FileTrees
julia>addprocs(10; exeflags="--project");
julia> tt =mapvalues(identity, maketree("root"=> ["next"=> [(name=string(x), value=1:10) for x in'a':'k']]); lazy=true)
root/
└─ next/
├─ a (Thunk(#71, (1:10,)))
├─ b (Thunk(#71, (1:10,)))
├─ c (Thunk(#71, (1:10,)))
├─ d (Thunk(#71, (1:10,)))
├─ e (Thunk(#71, (1:10,)))
├─ f (Thunk(#71, (1:10,)))
├─ g (Thunk(#71, (1:10,)))
├─ h (Thunk(#71, (1:10,)))
├─ i (Thunk(#71, (1:10,)))
├─ j (Thunk(#71, (1:10,)))
└─ k (Thunk(#71, (1:10,)))
julia>@everywherefunctionmyvcat(x, y)
@info"on $(myid())"vcat(x,y)
end
julia> ttm =mv(tt, r"next/[a-z]$", s"next"; combine=myvcat)
root/
└─ next (Thunk(myvcat, (Thunk(myvcat, ...), Thunk(#71, ...))))
julia>exec(ttm)
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
[ Info: on 13
root/
└─ next (110-element Vector{Int64})
julia> ttm =mapsubtrees(ttt ->reducevalues(myvcat, ttt), tt, r"[a-z]")
root/
└─ next/ (Thunk(myvcat, (Thunk(myvcat, ...), Thunk(myvcat, ...))))
julia>exec(ttm)
[ Info: on 13
[ Info: on 19
[ Info: on 16
[ Info: on 13
[ Info: on 14
[ Info: on 19
[ Info: on 14
[ Info: on 13
[ Info: on 19
[ Info: on 13
root/
└─ next/ (110-element Vector{Int64})
I believe that achieving the latter is one of the use cases of mv, right?
The text was updated successfully, but these errors were encountered:
I think this boils down to
merge
, butmv
makes for a simpler MWE. Glancing at the code it looks like it should parallelize, but maybe there is a good reason why it doesn't.I believe that achieving the latter is one of the use cases of
mv
, right?The text was updated successfully, but these errors were encountered: