Did the fishermen know Jesus before he called them?

Matthew doesn't say. He tells that Jesus "saw two brothers: Simon, who is called Peter, and Andrew, his brother, casting a net into the sea" (4:18), said, "Come after me, and I will make you fishers for men" (4:19), and "They immediately left their nets and followed him" (4:20). He tells of no earlier meeting and gives no reason they followed. The other Gospels tell more, each in its own way. John's Gospel tells of a day when "John was standing with two of his disciples" (John 1:35), and "One of the two who heard John and followed him was Andrew, Simon Peter’s brother" (John 1:40), who "first found his own brother, Simon" and "brought him to Jesus" (John 1:41-42). Luke tells of a great catch of fish with Simon, and James and John, after which "they left everything, and followed him" (Luke 5:11). Those are John's and Luke's accounts. These notes set them beside Matthew's and don't join them or say how they fit.