I didn't receive the short message about the result of my visa for visiting relatives in Japan. Is it rejected to get a passport directly?

This situation does not necessarily mean that the visa is refused.

If you receive your passport directly, but you don't receive the SMS or telephone notification about the visa result, it may be that the embassy or consulate will delay issuing the visa for various reasons, such as being in a hurry and verifying the materials. Ensure that the contact information filled in is true and effective, and ensure that you can answer the phone in time.