Skip to content

Remove ExecuTorch copy of Vectorized #7042

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 34 commits into
base: gh/swolchok/121/base
Choose a base branch
from

Conversation

swolchok
Copy link
Contributor

@swolchok swolchok commented Nov 23, 2024

Stack from ghstack (oldest at bottom):

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: D66396016

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Nov 23, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7042

Note: Links to docs will display an error until the docs builds have been completed.

❌ 70 New Failures, 1 Unrelated Failure

As of commit 7b16758 with merge base df75088 (image):

NEW FAILURES - The following jobs have failed:

  • Build documentation / build (buck2) / Build doc (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • Lint / lintrunner / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / android / build-llm-demo / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-custom-ops-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-eval_llama-mmlu-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-eval_llama-wikitext-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama_runner_eager-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-llama-runner-linux-android / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-llava-runner-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm<c10::BFloat16>(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, c10::BFloat16, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&)::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-moshi-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-openvino-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, CTYPE, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&) [with CTYPE = c10::BFloat16; torch::executor::native::Tensor = executorch::runtime::etensor::Tensor; executorch::runtime::IntArrayRef = executorch::runtime::ArrayRef<long int>]::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-phi-3-mini-runner-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-pybind-build-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-quantized-aot-lib-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-selective-build-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / test-setup-linux-gcc / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:32: error: no match for call to ‘(const torch::executor::native::{anonymous}::layer_norm(const Tensor&, executorch::runtime::IntArrayRef, const std::optional<executorch::runtime::etensor::Tensor>&, const std::optional<executorch::runtime::etensor::Tensor>&, CTYPE, torch::executor::native::Tensor&, torch::executor::native::Tensor&, torch::executor::native::Tensor&) [with CTYPE = c10::BFloat16; torch::executor::native::Tensor = executorch::runtime::etensor::Tensor; executorch::runtime::IntArrayRef = executorch::runtime::ArrayRef<long int>]::<lambda(Vec, Vec, Vec)>) (std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&, std::tuple_element<0, std::tuple<at::vec::CPU_CAPABILITY::Vectorized<float> > >::type&)’
  • pull / test-static-llama-qnn-linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest / linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest / macos / macos-job (gh)
    /Users/ec2-user/runner/_work/_temp/conda_environment_14717646748/lib/python3.11/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /Users/ec2-user/runner/_work/executorch/executorch/pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest-arm / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest-buck / linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest-buck / macos / macos-job (gh)
    /Users/ec2-user/runner/_work/_temp/conda_environment_14717646748/lib/python3.11/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /Users/ec2-user/runner/_work/executorch/executorch/pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest-editable / linux / linux-job (gh)
    /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'
  • pull / unittest-editable / macos / macos-job (gh)
    /Users/ec2-user/runner/_work/_temp/conda_environment_14717646748/lib/python3.11/site-packages/torch/include/ATen/cpu/vec/functional_bfloat16.h:500:25: error: no matching function for call to object of type 'const (lambda at /Users/ec2-user/runner/_work/executorch/executorch/pytorch/executorch/kernels/optimized/cpu/op_native_layer_norm.cpp:97:11)'

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 23, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Nov 23, 2024
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

ghstack-source-id: 255095942
Pull Request resolved: #7042
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Nov 23, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 255100702
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Nov 23, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 255101543
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Nov 26, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 255547405
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Dec 2, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 256068820
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Dec 2, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 256078544
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Dec 8, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 257038888
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Dec 17, 2024
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 258553931
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Jan 30, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263892114
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Jan 30, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263918323
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Jan 30, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263944262
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok added a commit that referenced this pull request Jan 30, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263951677
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok pushed a commit that referenced this pull request Feb 4, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263951677
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok pushed a commit that referenced this pull request Feb 4, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 263951677
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

@swolchok swolchok marked this pull request as draft February 5, 2025 16:47
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok pushed a commit that referenced this pull request Feb 6, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 265150327
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66396016

swolchok pushed a commit that referenced this pull request Feb 7, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 265190626
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@@ -1,51 +0,0 @@
/*
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hey @dbort does our bc policy require me to undelete all these files? saw you mentioned it recently but I don't know the exact text of the policy

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Policy is at https://pytorch.org/executorch/main/api-life-cycle.html

The goal of the policy is to avoid breaking user code that worked with the previous release. Removing a header could break code that currently works.

Looking at the files that this PR changes, I'm not totally sure if they really qualify as part of our public API; not sure if the headers under kernels/... are meant to be used outside the repo or if they're just for the code around them.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It could be if they are used to author custom ops out of the repo, but 1) I havent seen any examples in the wild and 2) I dont know if we package this header in our pip package (like pytorch) OR make it public somehow

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Apr 28, 2025
Pull Request resolved: #7042

All uses are outside ExecuTorch core, so we can just use ATen Vectorized.
ghstack-source-id: 280756645
@exported-using-ghexport

Differential Revision: [D66396016](https://our.internmc.facebook.com/intern/diff/D66396016/)
@swolchok
Copy link
Contributor Author

This will require pytorch/pytorch#152366 to be included in a pin bump before landing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported release notes: build Changes related to build, including dependency upgrades, build flags, optimizations, etc.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants