In a 2 quart saucepan, combine 1/2 cup butter, brown sugar, corn syrup, and sweetened condensed milk. Bring to a boil. Continue to boil for 5 minutes. Remove from heat and beat vigorously with a wooden spoon for about 3 minutes. Pour over baked crust (warm or cool). Cool until it begins to firm.