I think the cable is Single-Mode
Looks like your cable is single mode (yellow jacket generally indicates singlemode) and has four fibers in it.
and the termination should be with SC.
Or LC.
Either way when terminated there will be four connectors on the end of the cable, one for each fiber. These connectors may or may not be joined into pairs using clips.
I also probably need an SFP device, but as I searched, I should use 1000BASE-LX for single mode fiber.
1000BASE-LX (or LX10 which is basically the same, just with a longer maximum range) runs over a pair of single mode fibers, so your transciever will have a pair of connectors on it. You also get 1000BASE-BX which runs over a single strand of single mode fiber.
Note that it is necessary to cross over transmit and receive between the two transceivers. With LX this is done by crossing over the fibers. With BX this is done by using an "upstream" transceiver at one end of the link and a "downstream" transceiver at the other.
The question is I didn't see any SFP device with 1 SC connection. I am perplexed right now and need some help.
Due to space constraints SFP modules use LC rather than SC connectors.
I don't have any fiber patch panels and if there is a chance to connect without patch panel I will go for it.
A patch panel isn't absolutely essential but it is generally considered a very good idea. The individual strands of infrastructure fiber have very little protection while patch cables have separate Kevlar reinforcements for each individual fiber. A fiber patch panel should provide a place to secure the reinforcement of the infrastructure cable and then provide protection for the individual fibers as they pass to the couplers on the front of the patch panel.
The patch panel also means that if/when in the future you change to equipment that has different connectors you can simply replace the patch cord.
I am going to buy sockets and SFPs after I am sure about the right tools.
My advice would be to get the termination of the fiber done by a specialist and let him supply the connectors and patch panel. Learning to terminate fiber is a specialism in itself.