Here are some general criticisms about the form of reasoning which you noted people use.

A) Mere conceivability is not sufficient grounds upon which to make a claim about actuality/reality. It is conceivable that ghosts materialize and dematerialize at whim, but we have no independent reason to suppose that actually happens. Mere conceivability doesn't imply plausibility.

B) This seems like an ad hoc modification of the "ghosts exist and cause phenomenon" hypothesis, which is motivated by a prejudiced commitment to the hypothesis, not independent evidence or reasoning.

C) Presumably, someone who accepts that hypothesis does so because, if it were true, it would explain some phenomenonβ€”say, an object mysteriously turning up in a weird location. There are innumerable rival conceivable explanations that can be imagined with respect to any such phenomenon, some more plausible than others. The only rational way to select one out as the most likely explanation is by appeal to independent evidence or reasons.