No, you need to carefully compare the X Chromosome overlap with the shared amount of other autosomal DNA. The catch is that X Chr is relatively small and men have only one X Chr and women - two X Chr. So it makes very difficult to interpret results correctly.
Also as X Chr is investigated alone the provided results may prove very distant (and old!!!) relationship.
I believe that any match with X-DNA below 100cM (almost half of X Chr length) is false positive (i.e. does not have value)
I would like to add that you have a small amount of shared autosomal DNA with that particular person. It means that you share the same ethnicity (i.e. your and that person's ancestors lived in the same region), but there is no common ancestor.