Make the salad: Put the potatoes and garlic in a large pot. Add enough water to cover the potatoes by 2 inches and season generously with salt. Bring the water to a boil over high heat, then reduce the heat to medium and simmer until fork-tender, about 10 minutes.
cook the bacon in the olive oil in a large skillet over medium-high heat, stirring occasionally, until browned and crisp, about 10 minutes. Remove from the heat and stir in the onion, celery and vinegar. Season with salt.
Drain the potatoes and transfer them to a large bowl (discard the garlic). Add the bacon-onion mixture to the hot potatoes and stir to incorporate. Gently stir in 1 1/2 cups mayonnaise and the mustard and season with salt. Refrigerate until cold.