[Julia API] Use Ref{...} instead of length Vector{...} in the remaining places

Rewrites the remaining length-1 Vectors to Ref instead.

(Btw, feel free to squash if you prefer, the multiple commits are mostly for myself to keep things in order.)