Up should be the least pressure. When it starts coming down, that's when pressure is applied. Most engines have some sort of mark that indicates TDC. You might research that. The screwdriver method works too ...usually. The problem with the screwdriver method, is it's a judgement call, and not perfect. But it sounds suspiciously like maybe we're not quite at TDC. Just based on the symptoms, and subsequent description of same.
If there's no marks, at all, then try adjustment of the valves by rocking the engine. Look for the sweet spot, when the slack in the rod appears. Because that's likely where your tap is. Adjust that to tolerance specs. See if that improves the situation.