ox-latex: Fix temporary files removal when compiling files

* lisp/ox-latex.el (org-latex-compile): Assume temporary files are
  located in the output directory.

This partly reverts 120f8c0.

lisp/ox-latex.el

@@ -3612,10 +3612,7 @@ produced."
       (when org-latex-remove-logfiles
 	(mapc #'delete-file
 	      (directory-files
-	       ;; Assume auxiliary files are created in current
-	       ;; directory instead of ".tex" file directory, which
-	       ;; may differ.
-	       default-directory
+	       (file-name-directory outfile)
 	       nil
 	       (concat (regexp-quote (file-name-base outfile))
 		       "\\(?:\\.[0-9]+\\)?\\."