[shared github action workflow] Get rid of ref input (#94)

[shared github action workflow] Get rid of ref input (#94) #74